Apr 10 12:08:49 devstack cinder-volume[72877]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 12:08:49 devstack cinder-volume[72877]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 12:08:49 devstack cinder-volume[72877]: we strongly recommend against using it for new projects. Apr 10 12:08:49 devstack cinder-volume[72877]: If you are already using Eventlet, we recommend migrating to a different Apr 10 12:08:49 devstack cinder-volume[72877]: framework. For more detail see Apr 10 12:08:49 devstack cinder-volume[72877]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 12:08:49 devstack cinder-volume[72877]: import eventlet # noqa Apr 10 12:08:50 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 12:08:50 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 12:08:50 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 12:08:51 devstack cinder-volume[72877]: INFO dbcounter [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Registered counter for database cinder Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_db.sqlalchemy.engines [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG dbcounter [-] [72877] Writer thread running {{(pid=72877) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 12:08:51 devstack cinder-volume[72877]: INFO cinder.rpc [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 12:08:51 devstack cinder-volume[72877]: INFO cinder.rpc [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_db.sqlalchemy.engines [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:08:51 devstack cinder-volume[72877]: INFO cinder.volume.manager [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Determined volume DB was empty at startup. Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG cinder.volume.manager [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72877) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 12:08:51 devstack cinder-volume[72877]: INFO cinder.volume.manager [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 12:08:51 devstack cinder-volume[72877]: WARNING stevedore.named [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 12:08:51 devstack cinder-volume[72877]: WARNING castellan.key_manager [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 12:08:51 devstack cinder-volume[72877]: WARNING cinder.keymgr.conf_key_mgr [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG cinder.volume.drivers.lvm [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72877) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_concurrency.processutils [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72877) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_concurrency.processutils [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] CMD "cinder-rtstool verify" returned: 0 in 0.234s {{(pid=72877) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_db.sqlalchemy.engines [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:08:51 devstack cinder-volume[72877]: INFO cinder.rpc [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 10 12:08:51 devstack cinder-volume[72877]: INFO cinder.rpc [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 10 12:08:51 devstack cinder-volume[72877]: WARNING stevedore.named [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 12:08:51 devstack cinder-volume[72877]: WARNING castellan.key_manager [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 12:08:51 devstack cinder-volume[72877]: INFO cinder.volume.manager [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_db.sqlalchemy.engines [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72877) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:08:51 devstack cinder-volume[72877]: INFO oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Starting 1 workers Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Started child 72982 {{(pid=72877) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Full set of CONF: {{(pid=72877) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] ******************************************************************************** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Configuration options gathered from: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 12:08:51 devstack cinder-volume[72982]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] ================================================================================ {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] allow_availability_zone_fallback = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] allow_compression_on_image_upload = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] allowed_direct_url_schemes = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] api_rate_limit = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] auth_strategy = keystone {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] az_cache_duration = 3600 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_availability_zone = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_host = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_stats_polling_interval = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backup_api_class = cinder.backup.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backup_name_template = backup-%s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backup_use_same_host = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backup_use_temp_snapshot = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] chap_password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] chap_username = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_internal_tenant_project_id = dce6b643627e4dae951eabfb8d6d658d {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_internal_tenant_user_id = 274d072e90344596933444e0d0a6888d {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cloned_volume_same_az = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cluster = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] compression_format = gzip {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] compute_api_class = cinder.compute.nova.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] config_dir = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] config_source = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] control_exchange = openstack {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] debug = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] default_availability_zone = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] default_group_type = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] default_volume_type = lvmdriver-1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] disk_geometry = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] driver_client_cert = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] driver_client_cert_key = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] driver_data_namespace = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] driver_ssl_cert_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] driver_ssl_cert_verify = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] driver_use_ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] enable_force_upload = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] enable_new_services = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] enable_unsupported_driver = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] enabled_backends = ['lvmdriver-1'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] enforce_multipath_for_image_xfer = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] filter_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_api_insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_api_ssl_compression = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_ca_certificates_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_catalog_info = image:glance:publicURL {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_num_retries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance_request_timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] goodness_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] graceful_shutdown_timeout = 5 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] group_api_class = cinder.group.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] host = devstack {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_compress_on_upload = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_conversion_address_space_limit = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_conversion_cpu_limit = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_conversion_disable = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_upload_use_cinder_backend = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_upload_use_internal_tenant = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_volume_cache_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_volume_cache_max_count = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] image_volume_cache_max_size_gb = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] init_host_max_objects_retrieval = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] instance_format = [instance: %(uuid)s] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] iscsi_target_flags = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] iscsi_write_cache = on {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] iser_helper = tgtadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] iser_ip_address = 192.168.122.154 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] iser_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_color = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_config_append = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_dir = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:51 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_options = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_rotate_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_rotate_interval_type = days {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] log_rotation_type = none {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] max_age = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] max_logfile_count = 30 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] max_logfile_size_mb = 200 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] max_over_subscription_ratio = 20.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] message_reap_interval = 86400 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] message_ttl = 2592000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] migration_create_volume_timeout_secs = 300 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] monkey_patch = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] monkey_patch_modules = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] my_ip = 192.168.122.154 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] no_snapshot_gb_quota = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] num_iser_scan_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] num_shell_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] num_volume_device_scan_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] nvmeof_conn_info_version = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] nvmet_ns_id = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] nvmet_port_id = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] osapi_max_limit = 1000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] osapi_volume_ext_list = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] osapi_volume_listen_port = 8776 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72982]: INFO cinder.volume.manager [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] osapi_volume_use_ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] osapi_volume_workers = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] per_volume_size_limit = -1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] periodic_fuzzy_delay = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] periodic_interval = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] public_endpoint = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] publish_errors = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] quota_backup_gigabytes = 1000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] quota_backups = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] quota_gigabytes = 1000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] quota_groups = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] quota_snapshots = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] quota_volumes = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] rate_limit_burst = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] rate_limit_except_level = CRITICAL {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] rate_limit_interval = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] reinit_driver_count = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] replication_device = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] report_discard_supported = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] report_interval = 120 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] reservation_clean_interval = 86400 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] reservation_expire = 86400 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] reserved_image_namespaces = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] reserved_percentage = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] rpc_response_timeout = 120 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] run_external_periodic_tasks = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] scst_target_driver = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] scst_target_iqn_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_down_time = 720 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] shell_completion = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] snapshot_name_template = snapshot-%s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] snapshot_same_host = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] state_path = /opt/stack/data/cinder {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] storage_availability_zone = nova {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] storage_protocol = iSCSI {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] syslog_log_facility = LOG_USER {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] target_helper = lioadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] target_ip_address = 192.168.122.154 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] target_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] target_protocol = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] target_secondary_ip_addresses = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] trace_flags = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] transport_url = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] until_refresh = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] use_chap_auth = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] use_default_quota_class = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] use_journal = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] use_json = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] use_multipath_for_image_xfer = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] use_stderr = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] use_syslog = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] verify_glance_signatures = enabled {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_api_class = cinder.volume.api.API {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_backend_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_clear = zero {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_clear_ionice = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_clear_size = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_copy_bps_limit = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_dd_blocksize = 1M {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_name_template = volume-%s {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_service_inithost_offload = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volume_usage_audit_period = month {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] zoning_mode = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_concurrency.disable_process_locking = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.admin_password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.admin_token = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.admin_user = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.auth_admin_prefix = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.auth_port = 35357 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.auth_protocol = https {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.auth_section = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.auth_type = password {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.auth_uri = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.auth_version = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.cache = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.identity_uri = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.include_service_catalog = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.interface = public {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_password = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcache_username = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.region_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.service_token_roles_required = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.service_type = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.backend = dogpile.cache.null {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.backend_argument = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.backend_expiration_time = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.config_prefix = cache.oslo {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.debug_cache_backend = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.enable_retry_client = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.enable_socket_keepalive = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.enforce_fips_mode = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.expiration_time = 600 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.hashclient_retry_attempts = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.memcache_dead_retry = 300 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.memcache_pool_maxsize = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.memcache_sasl_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.proxies = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.redis_db = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.redis_server = localhost:6379 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.retry_attempts = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.retry_delay = 0.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.socket_keepalive_count = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.socket_keepalive_idle = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.socket_keepalive_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.socket_timeout = 1.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.tls_allowed_ciphers = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.tls_cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.tls_certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.tls_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.tls_keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cache.username = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] coordination.backend_url = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.asyncio_connection = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.asyncio_slave_connection = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.backend = sqlalchemy {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.connection = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.connection_debug = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.connection_parameters = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.connection_recycle_time = 3600 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.connection_trace = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.db_inc_retry_interval = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.db_max_retries = 20 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.db_max_retry_interval = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.db_retry_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.max_overflow = 50 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.max_pool_size = 5 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.max_retries = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.mysql_wsrep_sync_wait = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.pool_timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.retry_interval = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.slave_connection = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.sqlite_synchronous = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.synchronous_reader = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] database.use_db_reconnect = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.connection_string = messaging:// {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.es_doc_type = notification {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.es_scroll_size = 10000 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.es_scroll_time = 2m {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.filter_error_trace = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.hmac_keys = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.sentinel_service_name = mymaster {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.socket_timeout = 0.1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.trace_requests = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler.trace_sqlalchemy = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler_jaeger.process_tags = {} {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler_jaeger.service_name_prefix = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] profiler_otlp.service_name_prefix = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.enforce_new_defaults = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: WARNING oslo_config.cfg [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.enforce_scope = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.policy_default_rule = default {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.policy_file = policy.yaml {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] privsep_osbrick.group = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] privsep_osbrick.helper_command = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] privsep_osbrick.user = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_sys_admin.group = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_sys_admin.helper_command = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] cinder_sys_admin.user = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.auth_section = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.auth_type = password {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.collect_timing = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.send_service_user_token = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] service_user.timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.auth_section = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.auth_type = password {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.collect_timing = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.region_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] glance.timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.backend_availability_zone = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.chap_password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.chap_username = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.disk_geometry = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.driver_client_cert = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.driver_client_cert_key = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.driver_data_namespace = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.driver_use_ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.extra_capabilities = {} {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.filter_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.goodness_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack sudo[72987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 10 12:08:52 devstack sudo[72987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.iscsi_target_flags = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.iscsi_write_cache = on {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.iser_helper = tgtadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.iser_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.lvm_mirrors = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.lvm_share_target = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.lvm_type = auto {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.num_shell_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.replication_device = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.report_discard_supported = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.reserved_percentage = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.target_helper = tgtadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.target_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.target_protocol = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.trace_flags = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.unique_fqdn_network = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.use_chap_auth = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_backend_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_clear = zero {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_clear_ionice = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_clear_size = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volume_group = cinder-volumes {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_reports.file_event_handler = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_reports.log_dir = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.backend_availability_zone = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.backend_host = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.chap_password = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.chap_username = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.chiscsi_conf = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.disk_geometry = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.driver_client_cert = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.driver_data_namespace = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.driver_use_ssl = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.extra_capabilities = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.filter_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.goodness_function = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.iser_helper = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.iser_ip_address = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.iser_port = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.iser_target_prefix = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.lvm_conf_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.lvm_mirrors = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.lvm_share_target = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.lvm_type = auto {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.num_shell_tries = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.nvmet_port_id = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.replication_device = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.report_discard_supported = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.reserved_percentage = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.scst_target_driver = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.storage_protocol = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.target_helper = lioadm {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.target_ip_address = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.target_port = 3260 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.target_protocol = iscsi {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.trace_flags = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.use_chap_auth = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_clear = zero {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_clear_size = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] lvmdriver-1.volumes_dir = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_notifications.driver = [] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_notifications.retry = -1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] key_manager.fixed_key = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.barbican_api_version = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.barbican_endpoint = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.barbican_endpoint_type = public {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.barbican_region_name = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.collect_timing = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.number_of_retries = 60 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.retry_delay = 1 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.send_service_user_token = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.verify_ssl = True {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican.verify_ssl_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.auth_section = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.auth_type = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.cafile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.certfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.collect_timing = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.insecure = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.keyfile = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.split_loggers = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] barbican_service_user.timeout = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.approle_role_id = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.approle_secret_id = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.kv_mountpoint = secret {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.kv_path = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.kv_version = 2 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.namespace = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.root_token_id = **** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.ssl_ca_crt_file = None {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.timeout = 60.0 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.use_ssl = False {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:08:52 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] ******************************************************************************** {{(pid=72877) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 12:08:52 devstack sudo[72987]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.534s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:52 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:52 devstack sudo[72998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:08:52 devstack sudo[72998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:53 devstack sudo[72998]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:53 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.468s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:53 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:08:53 devstack cinder-volume[72982]: INFO cinder.brick.local_dev.lvm [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 10 12:08:53 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:53 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:53 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:53 devstack sudo[73238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 12:08:53 devstack sudo[73238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:53 devstack sudo[73238]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:53 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.548s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:53 devstack cinder-volume[72982]: DEBUG cinder.brick.local_dev.lvm [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72982) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 10 12:08:53 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:53 devstack sudo[73454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:08:53 devstack sudo[73454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:54 devstack sudo[73454]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:54 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.128s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:54 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:54 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:54 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:54 devstack sudo[73640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:08:54 devstack sudo[73640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:55 devstack sudo[73640]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:55 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.495s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:55 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:55 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:55 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:55 devstack sudo[73683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 10 12:08:55 devstack sudo[73683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:55 devstack sudo[73683]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:55 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.455s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:55 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:55 devstack sudo[73686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 12:08:55 devstack sudo[73686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:56 devstack sudo[73686]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:56 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.480s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:56 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:56 devstack sudo[73694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 12:08:56 devstack sudo[73694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:56 devstack sudo[73694]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:56 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.426s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:56 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:56 devstack sudo[73697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:08:56 devstack sudo[73697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:57 devstack sudo[73697]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:57 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.455s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:57 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:57 devstack sudo[73702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:08:57 devstack sudo[73702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:57 devstack sudo[73702]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:57 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.448s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:57 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:57 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:57 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:57 devstack sudo[73706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:08:57 devstack sudo[73706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:58 devstack sudo[73706]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:58 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.485s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:58 devstack cinder-volume[72982]: INFO cinder.volume.drivers.lvm [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 10 12:08:58 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:58 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:58 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:58 devstack sudo[73739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:08:58 devstack sudo[73739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:58 devstack sudo[73739]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:58 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:58 devstack cinder-volume[72982]: DEBUG cinder.volume.drivers.lvm [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Updating volume stats {{(pid=72982) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 12:08:58 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:58 devstack sudo[73831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 12:08:58 devstack sudo[73831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:59 devstack sudo[73831]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:59 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:59 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:59 devstack sudo[73911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:08:59 devstack sudo[73911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:59 devstack sudo[73911]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:59 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.450s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:59 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:08:59 devstack sudo[73974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:08:59 devstack sudo[73974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:08:59 devstack sudo[73974]: pam_unix(sudo:session): session closed for user root Apr 10 12:08:59 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.456s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:08:59 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:00 devstack sudo[73980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:09:00 devstack sudo[73980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:00 devstack sudo[73980]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.458s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:00 devstack cinder-volume[72982]: INFO cinder.volume.driver [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG cinder.volume.driver [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72982) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG oslo_db.sqlalchemy.engines [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72982) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG dbcounter [-] [72982] Writer thread running {{(pid=72982) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG cinder.db.sqlalchemy.api [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Building query based on filter {{(pid=72982) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG cinder.image.image_utils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72982) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 12:09:00 devstack cinder-volume[72982]: INFO cinder.keymgr.migration [None req-7a41b846-2df1-40bf-8dba-f2a4d2e78b1d None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG cinder.volume.drivers.lvm [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Updating volume stats {{(pid=72982) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:00 devstack sudo[73986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 12:09:00 devstack sudo[73986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:00 devstack sudo[73986]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.462s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:00 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:01 devstack sudo[73989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:09:01 devstack sudo[73989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:01 devstack sudo[73989]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:01 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.449s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:01 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:01 devstack sudo[73992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:09:01 devstack sudo[73992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:01 devstack sudo[73992]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:01 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.450s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:01 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:01 devstack sudo[73997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:09:01 devstack sudo[73997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:01 devstack cinder-volume[72877]: DEBUG dbcounter [-] [72877] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72877) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:09:02 devstack sudo[73997]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:02 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:02 devstack cinder-volume[72982]: DEBUG cinder.manager [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Notifying Schedulers of capabilities ... {{(pid=72982) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:09:02 devstack cinder-volume[72982]: INFO cinder.volume.manager [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Driver initialization completed successfully. Apr 10 12:09:02 devstack cinder-volume[72982]: INFO cinder.manager [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Initiating service 2 cleanup Apr 10 12:09:02 devstack cinder-volume[72982]: INFO cinder.manager [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Service 2 cleanup completed. Apr 10 12:09:02 devstack cinder-volume[72982]: DEBUG cinder.service [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Creating RPC server for service cinder-volume {{(pid=72982) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 12:09:02 devstack cinder-volume[72982]: DEBUG cinder.service [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72982) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 12:09:02 devstack cinder-volume[72982]: INFO cinder.volume.manager [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 10 12:09:02 devstack cinder-volume[72982]: DEBUG cinder.volume.drivers.lvm [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Updating volume stats {{(pid=72982) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 12:09:02 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:02 devstack sudo[74006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 12:09:02 devstack sudo[74006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:02 devstack sudo[74006]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:02 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.500s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:02 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:02 devstack sudo[74009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:09:02 devstack sudo[74009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:03 devstack sudo[74009]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:03 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.482s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:03 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:03 devstack sudo[74066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:09:03 devstack sudo[74066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:03 devstack sudo[74066]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:03 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.434s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:03 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:09:03 devstack sudo[74108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:09:03 devstack sudo[74108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:09:04 devstack sudo[74108]: pam_unix(sudo:session): session closed for user root Apr 10 12:09:04 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.435s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:09:04 devstack cinder-volume[72982]: INFO cinder.volume.manager [None req-24bed270-cd6f-451e-ba12-f55f378573b9 None None] Driver post RPC initialization completed successfully. Apr 10 12:09:14 devstack cinder-volume[72982]: DEBUG dbcounter [-] [72982] Writing DB stats cinder:SELECT=3 {{(pid=72982) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:09:14 devstack cinder-volume[72982]: DEBUG dbcounter [-] [72982] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72982) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:10:32 devstack cinder-volume[72982]: DEBUG oslo_service.periodic_task [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72982) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:10:32 devstack cinder-volume[72982]: DEBUG cinder.volume.drivers.lvm [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Updating volume stats {{(pid=72982) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 12:10:32 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:10:32 devstack sudo[79053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 12:10:32 devstack sudo[79053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:10:32 devstack sudo[79053]: pam_unix(sudo:session): session closed for user root Apr 10 12:10:32 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.434s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:10:32 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:10:32 devstack sudo[79056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:10:32 devstack sudo[79056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:10:33 devstack sudo[79056]: pam_unix(sudo:session): session closed for user root Apr 10 12:10:33 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:10:33 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:10:33 devstack sudo[79059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:10:33 devstack sudo[79059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:10:33 devstack sudo[79059]: pam_unix(sudo:session): session closed for user root Apr 10 12:10:33 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.429s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:10:33 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:10:33 devstack sudo[79062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:10:33 devstack sudo[79062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:10:34 devstack sudo[79062]: pam_unix(sudo:session): session closed for user root Apr 10 12:10:34 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.423s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:10:34 devstack cinder-volume[72982]: DEBUG cinder.manager [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Notifying Schedulers of capabilities ... {{(pid=72982) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:11:14 devstack cinder-volume[72982]: DEBUG dbcounter [-] [72982] Writing DB stats cinder:SELECT=1 {{(pid=72982) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:11:14 devstack cinder-volume[72982]: DEBUG dbcounter [-] [72982] Writing DB stats cinder:UPDATE=1 {{(pid=72982) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:11:32 devstack cinder-volume[72982]: DEBUG oslo_service.periodic_task [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72982) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:11:32 devstack cinder-volume[72982]: DEBUG cinder.volume.drivers.lvm [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Updating volume stats {{(pid=72982) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 10 12:11:32 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:11:32 devstack sudo[80939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 10 12:11:32 devstack sudo[80939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:11:32 devstack sudo[80939]: pam_unix(sudo:session): session closed for user root Apr 10 12:11:32 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.422s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:11:32 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:11:32 devstack sudo[80942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:11:32 devstack sudo[80942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:11:33 devstack sudo[80942]: pam_unix(sudo:session): session closed for user root Apr 10 12:11:33 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:11:33 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:11:33 devstack sudo[80955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 10 12:11:33 devstack sudo[80955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:11:33 devstack sudo[80955]: pam_unix(sudo:session): session closed for user root Apr 10 12:11:33 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.475s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:11:33 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:11:33 devstack sudo[80987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 10 12:11:33 devstack sudo[80987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:11:34 devstack sudo[80987]: pam_unix(sudo:session): session closed for user root Apr 10 12:11:34 devstack cinder-volume[72982]: DEBUG oslo_concurrency.processutils [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.512s {{(pid=72982) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:11:34 devstack cinder-volume[72982]: DEBUG cinder.manager [None req-b3dfa14c-d3ea-4c95-a63b-1c57ecbee605 None None] Notifying Schedulers of capabilities ... {{(pid=72982) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:12:21 devstack cinder-volume[72877]: INFO oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Caught SIGTERM, stopping children Apr 10 12:12:21 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Acquiring lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 12:12:21 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Acquired lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 12:12:21 devstack cinder-volume[72877]: DEBUG oslo_concurrency.lockutils [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Releasing lock "singleton_lock" {{(pid=72877) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 12:12:21 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Stop services. {{(pid=72877) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 12:12:21 devstack cinder-volume[72877]: DEBUG oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Killing children. {{(pid=72877) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 12:12:21 devstack cinder-volume[72877]: INFO oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Waiting on 1 children to exit Apr 10 12:12:22 devstack cinder-volume[72982]: DEBUG oslo_concurrency.lockutils [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Acquiring lock "singleton_lock" {{(pid=72982) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 12:12:22 devstack cinder-volume[72982]: DEBUG oslo_concurrency.lockutils [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Acquired lock "singleton_lock" {{(pid=72982) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 12:12:22 devstack cinder-volume[72982]: DEBUG oslo_concurrency.lockutils [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Releasing lock "singleton_lock" {{(pid=72982) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 12:12:22 devstack cinder-volume[72982]: WARNING amqp [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 12:12:22 devstack cinder-volume[72982]: WARNING amqp [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 12:12:22 devstack cinder-volume[72877]: INFO oslo_service.backend._eventlet.service [None req-03e117ce-7dfc-4b60-aec0-8572216b49c3 None None] Child 72982 exited with status 0 Apr 10 12:12:22 devstack cinder-volume[82031]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 12:12:22 devstack cinder-volume[82031]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 12:12:22 devstack cinder-volume[82031]: we strongly recommend against using it for new projects. Apr 10 12:12:22 devstack cinder-volume[82031]: If you are already using Eventlet, we recommend migrating to a different Apr 10 12:12:22 devstack cinder-volume[82031]: framework. For more detail see Apr 10 12:12:22 devstack cinder-volume[82031]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 12:12:22 devstack cinder-volume[82031]: import eventlet # noqa Apr 10 12:12:24 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 12:12:24 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 12:12:24 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 12:12:25 devstack cinder-volume[82031]: INFO dbcounter [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Registered counter for database cinder Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG dbcounter [-] [82031] Writer thread running {{(pid=82031) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 12:12:25 devstack cinder-volume[82031]: INFO cinder.rpc [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 12:12:25 devstack cinder-volume[82031]: INFO cinder.rpc [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:12:25 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Determined volume DB was empty at startup. Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG cinder.volume.manager [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82031) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 12:12:25 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 10 12:12:25 devstack cinder-volume[82031]: WARNING stevedore.named [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 12:12:25 devstack cinder-volume[82031]: WARNING castellan.key_manager [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 12:12:25 devstack cinder-volume[82031]: WARNING cinder.keymgr.conf_key_mgr [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 12:12:25 devstack cinder-volume[82031]: INFO cinder.volume.manager [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_db.sqlalchemy.engines [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82031) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:12:25 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Starting 1 workers Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Started child 82146 {{(pid=82031) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Full set of CONF: {{(pid=82031) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] ******************************************************************************** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Configuration options gathered from: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] ================================================================================ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] allow_availability_zone_fallback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] allow_compression_on_image_upload = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] allowed_direct_url_schemes = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] api_rate_limit = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] auth_strategy = keystone {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_host = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_stats_polling_interval = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backup_api_class = cinder.backup.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backup_name_template = backup-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backup_use_same_host = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backup_use_temp_snapshot = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] chap_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] chap_username = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_internal_tenant_project_id = dce6b643627e4dae951eabfb8d6d658d {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_internal_tenant_user_id = 274d072e90344596933444e0d0a6888d {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cluster = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] compression_format = gzip {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] compute_api_class = cinder.compute.nova.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] config_dir = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] config_source = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82146]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] control_exchange = openstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] debug = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] default_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] default_group_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] default_volume_type = QuobyteHD {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] disk_geometry = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] driver_client_cert = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] driver_client_cert_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] driver_data_namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] driver_ssl_cert_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] driver_ssl_cert_verify = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] driver_use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] enable_new_services = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] enable_unsupported_driver = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] enabled_backends = ['QuobyteHD'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] enforce_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] filter_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_api_insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_api_ssl_compression = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_ca_certificates_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_catalog_info = image:glance:publicURL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_num_retries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance_request_timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] goodness_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] graceful_shutdown_timeout = 5 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] group_api_class = cinder.group.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] host = devstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_compress_on_upload = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_conversion_address_space_limit = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_conversion_cpu_limit = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_conversion_disable = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_upload_use_cinder_backend = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_upload_use_internal_tenant = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_volume_cache_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_volume_cache_max_count = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] image_volume_cache_max_size_gb = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] init_host_max_objects_retrieval = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] instance_format = [instance: %(uuid)s] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] iscsi_target_flags = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] iscsi_write_cache = on {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] iser_helper = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] iser_ip_address = 192.168.122.154 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] iser_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_color = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_config_append = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_dir = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_options = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_rotate_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_rotate_interval_type = days {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] log_rotation_type = none {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] max_age = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] max_logfile_count = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] max_logfile_size_mb = 200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] max_over_subscription_ratio = 20.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] message_reap_interval = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] message_ttl = 2592000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] migration_create_volume_timeout_secs = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] monkey_patch = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] monkey_patch_modules = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] my_ip = 192.168.122.154 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] no_snapshot_gb_quota = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] num_iser_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] num_shell_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] num_volume_device_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] nvmeof_conn_info_version = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] nvmet_ns_id = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] nvmet_port_id = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] osapi_max_limit = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] osapi_volume_ext_list = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] osapi_volume_listen_port = 8776 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] osapi_volume_use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] osapi_volume_workers = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82146]: INFO cinder.volume.manager [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] per_volume_size_limit = -1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] periodic_fuzzy_delay = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82146]: DEBUG cinder.volume.drivers.remotefs [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82146) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] periodic_interval = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] public_endpoint = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] publish_errors = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] quota_backup_gigabytes = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] quota_backups = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] quota_gigabytes = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] quota_groups = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] quota_snapshots = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] quota_volumes = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] rate_limit_burst = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] rate_limit_except_level = CRITICAL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] rate_limit_interval = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] reinit_driver_count = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] replication_device = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] report_discard_supported = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] report_interval = 120 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] reservation_clean_interval = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] reservation_expire = 86400 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] reserved_image_namespaces = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] reserved_percentage = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] rpc_response_timeout = 120 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] run_external_periodic_tasks = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] scst_target_driver = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] scst_target_iqn_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_down_time = 720 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] shell_completion = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] snapshot_name_template = snapshot-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] state_path = /opt/stack/data/cinder {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] storage_availability_zone = nova {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] storage_protocol = iSCSI {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] syslog_log_facility = LOG_USER {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] target_helper = lioadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] target_ip_address = 192.168.122.154 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] target_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] target_protocol = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] target_secondary_ip_addresses = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] trace_flags = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] transport_url = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] until_refresh = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] use_chap_auth = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] use_default_quota_class = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] use_journal = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] use_json = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] use_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] use_stderr = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] use_syslog = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] verify_glance_signatures = enabled {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_api_class = cinder.volume.api.API {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_backend_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_clear = zero {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_clear_ionice = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_clear_size = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_copy_bps_limit = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_dd_blocksize = 1M {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_name_template = volume-%s {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_service_inithost_offload = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volume_usage_audit_period = month {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] zoning_mode = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_concurrency.disable_process_locking = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.admin_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.admin_token = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.admin_user = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.auth_port = 35357 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.auth_protocol = https {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.auth_type = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.auth_uri = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.auth_version = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.cache = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.identity_uri = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.include_service_catalog = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.interface = public {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_password = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82146]: DEBUG cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82146) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 12:12:25 devstack cinder-volume[82146]: WARNING cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 12:12:25 devstack cinder-volume[82146]: WARNING cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Running cmd (subprocess): mount.quobyte {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcache_username = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.region_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.service_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.backend = dogpile.cache.null {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.backend_argument = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.backend_expiration_time = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.config_prefix = cache.oslo {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.debug_cache_backend = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.enable_retry_client = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.enable_socket_keepalive = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.enforce_fips_mode = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.expiration_time = 600 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.hashclient_retry_attempts = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.memcache_dead_retry = 300 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.memcache_pool_maxsize = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.memcache_sasl_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.proxies = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.redis_db = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.redis_server = localhost:6379 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.retry_attempts = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.retry_delay = 0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.socket_keepalive_count = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.socket_keepalive_idle = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.socket_keepalive_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.socket_timeout = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.tls_allowed_ciphers = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.tls_cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.tls_certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.tls_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.tls_keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cache.username = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] coordination.backend_url = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.asyncio_connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.asyncio_slave_connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.backend = sqlalchemy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.connection_debug = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.connection_parameters = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.connection_recycle_time = 3600 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.connection_trace = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.db_inc_retry_interval = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.db_max_retries = 20 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.db_max_retry_interval = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.db_retry_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.max_overflow = 50 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.max_pool_size = 5 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.max_retries = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.mysql_wsrep_sync_wait = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.pool_timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.retry_interval = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.slave_connection = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.sqlite_synchronous = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.synchronous_reader = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] database.use_db_reconnect = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.connection_string = messaging:// {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.es_doc_type = notification {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.es_scroll_size = 10000 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.es_scroll_time = 2m {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.filter_error_trace = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.hmac_keys = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.sentinel_service_name = mymaster {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.socket_timeout = 0.1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.trace_requests = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler.trace_sqlalchemy = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler_jaeger.process_tags = {} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler_jaeger.service_name_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] profiler_otlp.service_name_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.enforce_new_defaults = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: WARNING oslo_config.cfg [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.enforce_scope = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.policy_default_rule = default {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.policy_file = policy.yaml {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] privsep_osbrick.group = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] privsep_osbrick.helper_command = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] privsep_osbrick.user = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_sys_admin.group = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_sys_admin.helper_command = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] cinder_sys_admin.user = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.auth_type = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.send_service_user_token = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] service_user.timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.auth_type = password {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack quobyte-client[82150]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 12:12:25 devstack quobyte-client[82150]: Invalid parameters found, error: missing mount point. Apr 10 12:12:25 devstack quobyte-client[82150]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 12:12:25 devstack quobyte-client[82150]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.region_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] glance.timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.backend_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.chap_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.chap_username = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.disk_geometry = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.driver_client_cert = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.driver_client_cert_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.driver_data_namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.driver_use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.extra_capabilities = {} {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.filter_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.goodness_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.iscsi_target_flags = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:12:25 devstack cinder-volume[82146]: DEBUG cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82146) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.iscsi_write_cache = on {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.iser_helper = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82146]: INFO cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 ... Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 -c /etc/quobyte/client-cinder.cfg {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.iser_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_host = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_login = admin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_mount_options = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_private_key = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_share_path = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.num_shell_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.quobyte_volume_url = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.replication_device = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.report_discard_supported = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.reserved_percentage = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.target_helper = tgtadm {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.target_port = 3260 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.target_protocol = iscsi {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack sudo[82151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 -c /etc/quobyte/client-cinder.cfg Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.trace_flags = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack sudo[82151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.unique_fqdn_network = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.use_chap_auth = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volume_backend_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volume_clear = zero {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volume_clear_ionice = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volume_clear_size = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_reports.file_event_handler = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_reports.log_dir = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.backend_availability_zone = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.backend_host = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.chap_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.chap_username = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.chiscsi_conf = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.disk_geometry = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.driver_client_cert = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.driver_data_namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.driver_use_ssl = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.extra_capabilities = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.filter_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.goodness_function = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.iser_helper = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.iser_ip_address = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.iser_port = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.iser_target_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_host = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_login = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_mount_options = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_password = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_private_key = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_share_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_ssh_port = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.num_shell_tries = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.nvmet_port_id = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.replication_device = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.report_discard_supported = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.reserved_percentage = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.scst_target_driver = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.storage_protocol = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.target_helper = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.target_ip_address = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.target_port = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.target_prefix = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.target_protocol = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.trace_flags = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.use_chap_auth = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volume_clear = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volume_clear_size = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] QuobyteHD.volumes_dir = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_notifications.driver = [] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_notifications.retry = -1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] key_manager.fixed_key = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.barbican_api_version = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.barbican_endpoint = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.barbican_endpoint_type = public {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.barbican_region_name = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.number_of_retries = 60 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.retry_delay = 1 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.send_service_user_token = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.verify_ssl = True {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican.verify_ssl_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.auth_section = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.auth_type = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.cafile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.certfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.collect_timing = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.insecure = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.keyfile = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.split_loggers = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] barbican_service_user.timeout = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.approle_role_id = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.approle_secret_id = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.kv_mountpoint = secret {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.kv_path = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.kv_version = 2 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.namespace = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.root_token_id = **** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.ssl_ca_crt_file = None {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.timeout = 60.0 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.use_ssl = False {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:25 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] ******************************************************************************** {{(pid=82031) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 12:12:26 devstack sudo[82151]: pam_unix(sudo:session): session closed for user root Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.504s {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:26 devstack cinder-volume[82146]: INFO cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 succeeded Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82146) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.534s {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:26 devstack sudo[82220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:12:26 devstack sudo[82220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:12:26 devstack sudo[82220]: pam_unix(sudo:session): session closed for user root Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.396s {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:26 devstack cinder-volume[82146]: INFO cinder.volume.driver [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG cinder.volume.driver [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82146) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_db.sqlalchemy.engines [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82146) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG dbcounter [-] [82146] Writer thread running {{(pid=82146) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG cinder.db.sqlalchemy.api [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Building query based on filter {{(pid=82146) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG cinder.image.image_utils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82146) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 12:12:26 devstack cinder-volume[82146]: INFO cinder.keymgr.migration [None req-7537e58d-af48-42f0-ba6c-b1b0124ad4f5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82146) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82146) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:12:26 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:26 devstack sudo[82223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:12:26 devstack sudo[82223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:12:27 devstack sudo[82223]: pam_unix(sudo:session): session closed for user root Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.409s {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG cinder.manager [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Notifying Schedulers of capabilities ... {{(pid=82146) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:12:27 devstack cinder-volume[82146]: INFO cinder.volume.manager [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Driver initialization completed successfully. Apr 10 12:12:27 devstack cinder-volume[82146]: INFO cinder.manager [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Initiating service 3 cleanup Apr 10 12:12:27 devstack cinder-volume[82146]: INFO cinder.manager [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Service 3 cleanup completed. Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG cinder.service [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Creating RPC server for service cinder-volume {{(pid=82146) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG cinder.service [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82146) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 12:12:27 devstack cinder-volume[82146]: INFO cinder.volume.manager [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82146) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG cinder.volume.drivers.quobyte [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82146) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82146) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:27 devstack sudo[82228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:12:27 devstack sudo[82228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:12:27 devstack sudo[82228]: pam_unix(sudo:session): session closed for user root Apr 10 12:12:27 devstack cinder-volume[82146]: DEBUG oslo_concurrency.processutils [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.442s {{(pid=82146) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:27 devstack cinder-volume[82146]: INFO cinder.volume.manager [None req-7520832a-356d-4963-8f2b-0e35152fb402 None None] Driver post RPC initialization completed successfully. Apr 10 12:12:29 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Caught SIGTERM, stopping children Apr 10 12:12:29 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Acquiring lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 12:12:29 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Acquired lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 12:12:29 devstack cinder-volume[82031]: DEBUG oslo_concurrency.lockutils [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Releasing lock "singleton_lock" {{(pid=82031) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 12:12:29 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Stop services. {{(pid=82031) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 10 12:12:29 devstack cinder-volume[82031]: DEBUG oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Killing children. {{(pid=82031) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 10 12:12:29 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Waiting on 1 children to exit Apr 10 12:12:31 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Acquiring lock "singleton_lock" {{(pid=82146) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 12:12:31 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Acquired lock "singleton_lock" {{(pid=82146) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 12:12:31 devstack cinder-volume[82146]: DEBUG oslo_concurrency.lockutils [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Releasing lock "singleton_lock" {{(pid=82146) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 12:12:31 devstack cinder-volume[82146]: WARNING amqp [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 12:12:31 devstack cinder-volume[82146]: WARNING amqp [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 10 12:12:31 devstack cinder-volume[82031]: INFO oslo_service.backend._eventlet.service [None req-fd45a890-cd19-4338-920f-17dbceaf3a73 None None] Child 82146 exited with status 0 Apr 10 12:12:31 devstack cinder-volume[82367]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 10 12:12:31 devstack cinder-volume[82367]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 12:12:31 devstack cinder-volume[82367]: we strongly recommend against using it for new projects. Apr 10 12:12:31 devstack cinder-volume[82367]: If you are already using Eventlet, we recommend migrating to a different Apr 10 12:12:31 devstack cinder-volume[82367]: framework. For more detail see Apr 10 12:12:31 devstack cinder-volume[82367]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 12:12:31 devstack cinder-volume[82367]: import eventlet # noqa Apr 10 12:12:33 devstack cinder-volume[82367]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82367) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 10 12:12:33 devstack cinder-volume[82367]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82367) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 10 12:12:33 devstack cinder-volume[82367]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82367) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 10 12:12:33 devstack cinder-volume[82367]: INFO dbcounter [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Registered counter for database cinder Apr 10 12:12:33 devstack cinder-volume[82367]: DEBUG oslo_db.sqlalchemy.engines [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82367) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG dbcounter [-] [82367] Writer thread running {{(pid=82367) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 12:12:34 devstack cinder-volume[82367]: INFO cinder.rpc [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 10 12:12:34 devstack cinder-volume[82367]: INFO cinder.rpc [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_db.sqlalchemy.engines [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82367) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:12:34 devstack cinder-volume[82367]: INFO cinder.volume.manager [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Determined volume DB was empty at startup. Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG cinder.volume.manager [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82367) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 10 12:12:34 devstack cinder-volume[82367]: WARNING stevedore.named [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 10 12:12:34 devstack cinder-volume[82367]: WARNING castellan.key_manager [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 12:12:34 devstack cinder-volume[82367]: WARNING cinder.keymgr.conf_key_mgr [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 10 12:12:34 devstack cinder-volume[82367]: INFO cinder.volume.manager [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_db.sqlalchemy.engines [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82367) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:12:34 devstack cinder-volume[82367]: INFO oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Starting 1 workers Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Started child 82546 {{(pid=82367) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Full set of CONF: {{(pid=82367) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] ******************************************************************************** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Configuration options gathered from: {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] ================================================================================ {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] allow_availability_zone_fallback = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] allow_compression_on_image_upload = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] allowed_direct_url_schemes = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] api_rate_limit = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] auth_strategy = keystone {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_availability_zone = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_host = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_stats_polling_interval = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backup_api_class = cinder.backup.api.API {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backup_name_template = backup-%s {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backup_use_same_host = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backup_use_temp_snapshot = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] chap_password = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] chap_username = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82546]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_internal_tenant_project_id = dce6b643627e4dae951eabfb8d6d658d {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_internal_tenant_user_id = 274d072e90344596933444e0d0a6888d {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cluster = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] compression_format = gzip {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] compute_api_class = cinder.compute.nova.API {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] config_dir = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] config_source = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] control_exchange = openstack {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] debug = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] default_availability_zone = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] default_group_type = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] default_volume_type = QuobyteHD {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] disk_geometry = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] driver_client_cert = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] driver_client_cert_key = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] driver_data_namespace = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82546) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] driver_ssl_cert_path = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] driver_ssl_cert_verify = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] driver_use_ssl = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] enable_new_services = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] enable_unsupported_driver = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] enabled_backends = ['QuobyteHD'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] enforce_multipath_for_image_xfer = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] filter_function = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_api_insecure = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_api_servers = ['http://192.168.122.154/image'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_api_ssl_compression = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_ca_certificates_file = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_catalog_info = image:glance:publicURL {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_certfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_keyfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_num_retries = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance_request_timeout = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] goodness_function = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] graceful_shutdown_timeout = 5 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] group_api_class = cinder.group.api.API {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] host = devstack {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_compress_on_upload = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_conversion_address_space_limit = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_conversion_cpu_limit = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_conversion_disable = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_upload_use_cinder_backend = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_upload_use_internal_tenant = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_volume_cache_enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_volume_cache_max_count = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] image_volume_cache_max_size_gb = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] init_host_max_objects_retrieval = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] instance_format = [instance: %(uuid)s] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] iscsi_target_flags = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] iscsi_write_cache = on {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] iser_helper = tgtadm {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] iser_ip_address = 192.168.122.154 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] iser_port = 3260 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_color = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_config_append = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_dir = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_file = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_options = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_rotate_interval = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_rotate_interval_type = days {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] log_rotation_type = none {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] max_age = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] max_logfile_count = 30 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] max_logfile_size_mb = 200 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] max_over_subscription_ratio = 20.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] message_reap_interval = 86400 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] message_ttl = 2592000 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] migration_create_volume_timeout_secs = 300 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] monkey_patch = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] monkey_patch_modules = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] my_ip = 192.168.122.154 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] no_snapshot_gb_quota = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] num_iser_scan_tries = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] num_shell_tries = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] num_volume_device_scan_tries = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] nvmeof_conn_info_version = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] nvmet_ns_id = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] nvmet_port_id = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] osapi_max_limit = 1000 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] osapi_volume_ext_list = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] osapi_volume_listen_port = 8776 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] osapi_volume_use_ssl = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] osapi_volume_workers = 2 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] per_volume_size_limit = -1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] periodic_fuzzy_delay = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] periodic_interval = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] public_endpoint = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] publish_errors = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] quota_backup_gigabytes = 1000 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] quota_backups = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] quota_gigabytes = 1000 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] quota_groups = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] quota_snapshots = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] quota_volumes = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] rate_limit_burst = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] rate_limit_except_level = CRITICAL {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] rate_limit_interval = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] reinit_driver_count = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] replication_device = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] report_discard_supported = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] report_interval = 120 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] reservation_clean_interval = 86400 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] reservation_expire = 86400 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] reserved_image_namespaces = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] reserved_percentage = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] rpc_response_timeout = 120 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] run_external_periodic_tasks = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] scst_target_driver = iscsi {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] scst_target_iqn_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_down_time = 720 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] shell_completion = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] snapshot_name_template = snapshot-%s {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] split_loggers = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] state_path = /opt/stack/data/cinder {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82546) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 10 12:12:34 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 10 12:12:34 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Running cmd (subprocess): mount.quobyte {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] storage_availability_zone = nova {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] storage_protocol = iSCSI {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] syslog_log_facility = LOG_USER {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] target_helper = lioadm {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] target_ip_address = 192.168.122.154 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] target_port = 3260 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] target_protocol = iscsi {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] target_secondary_ip_addresses = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] trace_flags = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] transport_url = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] until_refresh = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] use_chap_auth = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] use_default_quota_class = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] use_journal = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] use_json = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] use_multipath_for_image_xfer = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] use_stderr = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] use_syslog = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] verify_glance_signatures = enabled {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_api_class = cinder.volume.api.API {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_backend_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_clear = zero {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_clear_ionice = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_clear_size = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_copy_bps_limit = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_dd_blocksize = 1M {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_name_template = volume-%s {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_service_inithost_offload = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volume_usage_audit_period = month {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] zoning_mode = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_concurrency.disable_process_locking = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.admin_password = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.admin_token = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.admin_user = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.auth_port = 35357 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.auth_protocol = https {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.auth_section = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.auth_type = password {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.auth_uri = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.auth_version = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.cache = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.certfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.identity_uri = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.include_service_catalog = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.insecure = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.interface = public {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.keyfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_password = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack quobyte-client[82552]: Reading configuration file: /etc/quobyte/client.cfg Apr 10 12:12:34 devstack quobyte-client[82552]: Invalid parameters found, error: missing mount point. Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcache_username = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack quobyte-client[82552]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] CMD "mount.quobyte" returned: 1 in 0.164s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:34 devstack quobyte-client[82552]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.region_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.service_type = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.154/identity {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.backend = dogpile.cache.null {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.backend_argument = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.backend_expiration_time = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.config_prefix = cache.oslo {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.debug_cache_backend = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.enable_retry_client = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.enable_socket_keepalive = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.enforce_fips_mode = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.expiration_time = 600 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.hashclient_retry_attempts = 2 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.memcache_dead_retry = 300 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.memcache_pool_maxsize = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.memcache_sasl_enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.password = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.proxies = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.redis_db = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:12:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.redis_server = localhost:6379 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.retry_attempts = 2 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.retry_delay = 0.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.socket_keepalive_count = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.socket_keepalive_idle = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.socket_keepalive_interval = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.socket_timeout = 1.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.tls_allowed_ciphers = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.tls_cafile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.tls_certfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.tls_enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.tls_keyfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cache.username = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] coordination.backend_url = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.asyncio_connection = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.asyncio_slave_connection = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.backend = sqlalchemy {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack sudo[82580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.connection = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.connection_debug = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack sudo[82580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.connection_parameters = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.connection_recycle_time = 3600 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.connection_trace = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.db_inc_retry_interval = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.db_max_retries = 20 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.db_max_retry_interval = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.db_retry_interval = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.max_overflow = 50 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.max_pool_size = 5 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.max_retries = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.mysql_wsrep_sync_wait = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.pool_timeout = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.retry_interval = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.slave_connection = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.sqlite_synchronous = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.synchronous_reader = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] database.use_db_reconnect = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.connection_string = messaging:// {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.es_doc_type = notification {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.es_scroll_size = 10000 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.es_scroll_time = 2m {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.filter_error_trace = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.hmac_keys = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.sentinel_service_name = mymaster {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.socket_timeout = 0.1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.trace_requests = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler.trace_sqlalchemy = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler_jaeger.process_tags = {} {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler_jaeger.service_name_prefix = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] profiler_otlp.service_name_prefix = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.enforce_new_defaults = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: WARNING oslo_config.cfg [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.enforce_scope = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.policy_default_rule = default {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.policy_file = policy.yaml {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] privsep_osbrick.group = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] privsep_osbrick.helper_command = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] privsep_osbrick.user = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_sys_admin.group = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_sys_admin.helper_command = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] cinder_sys_admin.user = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.auth_section = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.auth_type = password {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.cafile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.certfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.collect_timing = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.insecure = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.keyfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.send_service_user_token = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.split_loggers = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] service_user.timeout = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.auth_section = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.auth_type = password {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.certfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.collect_timing = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.insecure = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.keyfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.region_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.split_loggers = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] glance.timeout = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.backend_availability_zone = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.chap_password = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.chap_username = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.disk_geometry = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.driver_client_cert = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.driver_client_cert_key = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.driver_data_namespace = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.driver_use_ssl = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.extra_capabilities = {} {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.filter_function = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.goodness_function = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.iscsi_target_flags = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.iscsi_write_cache = on {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.iser_helper = tgtadm {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.iser_ip_address = 192.168.122.154 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.iser_port = 3260 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_host = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_login = admin {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_mount_options = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_password = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_private_key = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_share_path = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.num_shell_tries = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.quobyte_volume_url = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.replication_device = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.report_discard_supported = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.reserved_percentage = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.target_helper = tgtadm {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.target_ip_address = 192.168.122.154 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.target_port = 3260 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.target_protocol = iscsi {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.trace_flags = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.unique_fqdn_network = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.use_chap_auth = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volume_backend_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volume_clear = zero {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volume_clear_ionice = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volume_clear_size = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_reports.file_event_handler = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_reports.log_dir = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.backend_availability_zone = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.backend_host = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.chap_password = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.chap_username = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.chiscsi_conf = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.disk_geometry = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.driver_client_cert = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.driver_data_namespace = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.driver_use_ssl = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.extra_capabilities = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.filter_function = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.goodness_function = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.iser_helper = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.iser_ip_address = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.iser_port = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.iser_target_prefix = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_host = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_login = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_mount_options = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_password = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_private_key = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_share_path = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_ssh_port = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.num_shell_tries = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.nvmet_port_id = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.replication_device = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.report_discard_supported = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.reserved_percentage = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.scst_target_driver = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.storage_protocol = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.target_helper = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.target_ip_address = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.target_port = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.target_prefix = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.target_protocol = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.trace_flags = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.use_chap_auth = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volume_clear = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volume_clear_size = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] QuobyteHD.volumes_dir = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.ssl = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_notifications.driver = [] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_notifications.retry = -1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] key_manager.fixed_key = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.barbican_api_version = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.barbican_endpoint = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.barbican_endpoint_type = public {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.barbican_region_name = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.cafile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.certfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.collect_timing = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.insecure = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.keyfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.number_of_retries = 60 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.retry_delay = 1 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.send_service_user_token = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.split_loggers = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.timeout = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.verify_ssl = True {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican.verify_ssl_path = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.auth_section = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.auth_type = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.cafile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.certfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.collect_timing = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.insecure = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.keyfile = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.split_loggers = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] barbican_service_user.timeout = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.approle_role_id = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.approle_secret_id = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.kv_mountpoint = secret {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.kv_path = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.kv_version = 2 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.namespace = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.root_token_id = **** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.ssl_ca_crt_file = None {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.timeout = 60.0 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.use_ssl = False {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 10 12:12:34 devstack cinder-volume[82367]: DEBUG oslo_service.backend._eventlet.service [None req-d65e9453-c76e-477c-81e2-beb4bdf9b539 None None] ******************************************************************************** {{(pid=82367) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 10 12:12:35 devstack sudo[82580]: pam_unix(sudo:session): session closed for user root Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.427s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:35 devstack cinder-volume[82546]: INFO cinder.volume.driver [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Driver hasn't implemented _init_vendor_properties() Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.volume.driver [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82546) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_db.sqlalchemy.engines [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82546) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writer thread running {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.db.sqlalchemy.api [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Building query based on filter {{(pid=82546) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82546) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:35 devstack cinder-volume[82546]: INFO cinder.keymgr.migration [None req-8b44ea9a-8558-4b12-b40f-1221deb1aefb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 10 12:12:35 devstack sudo[82602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:12:35 devstack sudo[82602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:12:35 devstack sudo[82602]: pam_unix(sudo:session): session closed for user root Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.375s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:12:35 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Driver initialization completed successfully. Apr 10 12:12:35 devstack cinder-volume[82546]: INFO cinder.manager [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Initiating service 3 cleanup Apr 10 12:12:35 devstack cinder-volume[82546]: INFO cinder.manager [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Service 3 cleanup completed. Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.service [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Creating RPC server for service cinder-volume {{(pid=82546) start /opt/stack/cinder/cinder/service.py:231}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.service [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82546) start /opt/stack/cinder/cinder/service.py:237}} Apr 10 12:12:35 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:12:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:12:35 devstack sudo[82613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:12:35 devstack sudo[82613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:12:36 devstack sudo[82613]: pam_unix(sudo:session): session closed for user root Apr 10 12:12:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.446s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:12:36 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f1089628-b259-4bcf-9e63-5fe22e2f2b35 None None] Driver post RPC initialization completed successfully. Apr 10 12:12:44 devstack cinder-volume[82367]: DEBUG dbcounter [-] [82367] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82367) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:12:45 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=2 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:12:46 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Flow 'volume_create_manager' (2ade3cd8-2beb-4fbe-8048-08bc06ccf1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d786321e-e393-47af-928a-89e7e5633677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d786321e-e393-47af-928a-89e7e5633677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-133966732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334d8edf-ea65-4df1-abb3-0428630a211d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec993cd76ab49b797e925aee9f3635d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:13:34Z,use_quota=True,user_id='ee92d64972744c96ae8f4d38218f3fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665e17f2-0473-4a5d-abfe-548cb5c0a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (665e17f2-0473-4a5d-abfe-548cb5c0a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc0eac1-9077-4a90-b05d-59f0e17aabb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc0eac1-9077-4a90-b05d-59f0e17aabb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334d8edf-ea65-4df1-abb3-0428630a211d', 'volume_name': 'volume-334d8edf-ea65-4df1-abb3-0428630a211d', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d9e18b-41f8-4160-8bc2-f4b0f5e86d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91d9e18b-41f8-4160-8bc2-f4b0f5e86d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69226c8-1f78-4240-9e6a-0fc014c8f619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:34 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Volume 334d8edf-ea65-4df1-abb3-0428630a211d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334d8edf-ea65-4df1-abb3-0428630a211d', 'volume_size': 1} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-133966732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334d8edf-ea65-4df1-abb3-0428630a211d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ec993cd76ab49b797e925aee9f3635d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:13:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:13:34Z,use_quota=True,user_id='ee92d64972744c96ae8f4d38218f3fd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Creating volume 334d8edf-ea65-4df1-abb3-0428630a211d {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:13:34 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:13:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:13:34 devstack sudo[83053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d 1073741824 Apr 10 12:13:34 devstack sudo[83053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:36 devstack sudo[83053]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d 1073741824" returned: 0 in 1.898s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:13:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:13:36 devstack sudo[83411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d Apr 10 12:13:36 devstack sudo[83411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:37 devstack sudo[83411]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d" returned: 0 in 0.905s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:13:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] <== create_volume: return (2909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:13:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.911s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:13:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a69226c8-1f78-4240-9e6a-0fc014c8f619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334d8edf-ea65-4df1-abb3-0428630a211d', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360968c-4d24-405d-9807-d9fb0b61de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:37 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Volume volume-334d8edf-ea65-4df1-abb3-0428630a211d (334d8edf-ea65-4df1-abb3-0428630a211d): created successfully Apr 10 12:13:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2360968c-4d24-405d-9807-d9fb0b61de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Flow 'volume_create_manager' (2ade3cd8-2beb-4fbe-8048-08bc06ccf1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:13:37 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-67da39c6-c3f8-4f69-bb17-7360826962c1 tempest-DeleteServersTestJSON-1002058408 None] Created volume successfully. Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Flow 'volume_create_manager' (bbbb9357-ffc8-4145-8281-1219a0b2eac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081bdf1c-b898-49ee-8441-ff6d14e526c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (081bdf1c-b898-49ee-8441-ff6d14e526c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1470361594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0760aa1e-bc44-43c7-8fd6-352d1504c965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada0dbc91150489fad53d32538a96fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:13:39Z,use_quota=True,user_id='2673bc54600f44799336247afcc2ced6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7843d818-cddb-4f2e-ba2c-76b9dda389c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7843d818-cddb-4f2e-ba2c-76b9dda389c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372728c4-b4d0-43e9-b7fb-fa5e544ed054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (372728c4-b4d0-43e9-b7fb-fa5e544ed054) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0760aa1e-bc44-43c7-8fd6-352d1504c965', 'volume_name': 'volume-0760aa1e-bc44-43c7-8fd6-352d1504c965', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c996933-55f5-479a-9c03-1b3fd71256b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c996933-55f5-479a-9c03-1b3fd71256b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e41eab0-5c41-404a-96a9-e4d152397318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:38 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Volume 0760aa1e-bc44-43c7-8fd6-352d1504c965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0760aa1e-bc44-43c7-8fd6-352d1504c965', 'volume_size': 1} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:13:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1470361594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0760aa1e-bc44-43c7-8fd6-352d1504c965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ada0dbc91150489fad53d32538a96fe0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:13:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:13:39Z,use_quota=True,user_id='2673bc54600f44799336247afcc2ced6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Creating volume 0760aa1e-bc44-43c7-8fd6-352d1504c965 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:13:38 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:13:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:13:38 devstack sudo[83421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 1073741824 Apr 10 12:13:38 devstack sudo[83421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:40 devstack sudo[83421]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 1073741824" returned: 0 in 1.107s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:13:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:13:40 devstack sudo[83426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 Apr 10 12:13:40 devstack sudo[83426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:41 devstack sudo[83426]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965" returned: 0 in 1.193s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:13:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] <== create_volume: return (2332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:13:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.333s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:13:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e41eab0-5c41-404a-96a9-e4d152397318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0760aa1e-bc44-43c7-8fd6-352d1504c965', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f320da91-f87f-42a8-8f30-9933c88eb51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:13:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Volume volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 (0760aa1e-bc44-43c7-8fd6-352d1504c965): created successfully Apr 10 12:13:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f320da91-f87f-42a8-8f30-9933c88eb51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:13:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Flow 'volume_create_manager' (bbbb9357-ffc8-4145-8281-1219a0b2eac4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:13:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-4b7e0366-8970-4669-8798-3dd0f1962815 tempest-VolumesAdminNegativeTest-1073387322 None] Created volume successfully. Apr 10 12:13:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Acquiring lock "cinder-0760aa1e-bc44-43c7-8fd6-352d1504c965-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:13:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "cinder-0760aa1e-bc44-43c7-8fd6-352d1504c965-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:13:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Acquiring lock "cinder-quobyte-0760aa1e-bc44-43c7-8fd6-352d1504c965" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:13:43 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "cinder-quobyte-0760aa1e-bc44-43c7-8fd6-352d1504c965" acquired by "delete_volume" :: waited 0.040s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:13:43 devstack cinder-volume[82546]: INFO oslo.privsep.daemon [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3qrr460g/privsep.sock'] Apr 10 12:13:43 devstack sudo[83448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3qrr460g/privsep.sock Apr 10 12:13:43 devstack sudo[83448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 12:13:43 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: Apr 10 12:13:44 devstack cinder-volume[82546]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 10 12:13:45 devstack cinder-volume[82546]: WARNING py.warnings [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 10 12:13:45 devstack cinder-volume[82546]: .first() Apr 10 12:13:45 devstack cinder-volume[82546]: Apr 10 12:13:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:13:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:13:45 devstack sudo[83448]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:45 devstack cinder-volume[82546]: INFO oslo.privsep.daemon [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Spawned new privsep daemon via rootwrap Apr 10 12:13:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Accepted privsep connection to /tmp/tmp3qrr460g/privsep.sock {{(pid=82546) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 10 12:13:45 devstack cinder-volume[82546]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 10 12:13:45 devstack cinder-volume[82546]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 10 12:13:45 devstack cinder-volume[82546]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 10 12:13:45 devstack cinder-volume[82546]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83475 Apr 10 12:13:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f91ca1c-2699-4c2e-90f2-de061c91da79]: (2,) {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:13:45 devstack cinder-volume[82546]: WARNING oslo_privsep.priv_context [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] privsep daemon already running Apr 10 12:13:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba55d282-fedb-4f43-9af8-23def4123712]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:13:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:13:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68b416b-1ce4-4782-9b25-0788e5624677]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:13:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:13:45 devstack sudo[83481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 Apr 10 12:13:45 devstack sudo[83481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:45 devstack sudo[83480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d Apr 10 12:13:45 devstack sudo[83480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:46 devstack sudo[83480]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d" returned: 0 in 1.188s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:13:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.807s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:13:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196', 'name': 'volume-334d8edf-ea65-4df1-abb3-0428630a211d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cde0d10c-0f31-451a-b7b3-465c0a60fbd5', 'enforce_multipath': True} {{(pid=82546) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 12:13:47 devstack sudo[83481]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965" returned: 0 in 1.507s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:13:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:13:47 devstack sudo[83491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965 Apr 10 12:13:47 devstack sudo[83491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-8f4ce047-ca88-4290-a145-04ac1125bf5a req-2370b18c-c1ed-4e57-88f1-d24176fcb68a tempest-DeleteServersTestJSON-1002058408 None] attachment_update completed successfully. Apr 10 12:13:48 devstack sudo[83491]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0760aa1e-bc44-43c7-8fd6-352d1504c965" returned: 0 in 1.166s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:13:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "cinder-quobyte-0760aa1e-bc44-43c7-8fd6-352d1504c965" released by "delete_volume" :: held 5.484s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:13:48 devstack cinder-volume[82546]: WARNING cinder.quota [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:13:48 devstack cinder-volume[82546]: WARNING cinder.quota [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:13:48 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Created reservations ['e9784c16-9dec-44be-bb9c-05ad0283161a', '722d1bd2-b9c4-470e-ae42-16efea7b5beb', '07b5ffe6-944e-4006-b895-9064597fe0f1', '534704b9-663b-43ac-8282-116bbbd5119a'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:13:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:13:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:13:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:13:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:13:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:13:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:13:49 devstack sudo[83913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:13:49 devstack sudo[83913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:13:50 devstack sudo[83913]: pam_unix(sudo:session): session closed for user root Apr 10 12:13:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.847s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:13:50 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:13:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Deleted volume successfully. Apr 10 12:13:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e327620f-4fbd-44e1-8b1f-d786432cacc6 tempest-VolumesAdminNegativeTest-1073387322 None] Lock "cinder-0760aa1e-bc44-43c7-8fd6-352d1504c965-delete_volume" released by "delete_volume" :: held 7.136s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:13:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-8f6c4550-1af0-4aa2-914b-7bb16ea6a1e9 req-9349ed49-9b1a-4084-bec2-8054f77479fe tempest-DeleteServersTestJSON-1002058408 None] Terminate volume connection completed successfully. Apr 10 12:13:55 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-8f6c4550-1af0-4aa2-914b-7bb16ea6a1e9 req-9349ed49-9b1a-4084-bec2-8054f77479fe tempest-DeleteServersTestJSON-1002058408 None] Deleting attachment cde0d10c-0f31-451a-b7b3-465c0a60fbd5. {{(pid=82546) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 12:14:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Acquiring lock "cinder-334d8edf-ea65-4df1-abb3-0428630a211d-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Lock "cinder-334d8edf-ea65-4df1-abb3-0428630a211d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Acquiring lock "cinder-quobyte-334d8edf-ea65-4df1-abb3-0428630a211d" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Lock "cinder-quobyte-334d8edf-ea65-4df1-abb3-0428630a211d" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:00 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e4c9aa-a9f8-48ca-8020-5da3d2e64a8d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:00 devstack sudo[84101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d Apr 10 12:14:00 devstack sudo[84101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:01 devstack sudo[84101]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d" returned: 0 in 0.852s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:01 devstack sudo[84119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d Apr 10 12:14:01 devstack sudo[84119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:01 devstack sudo[84119]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-334d8edf-ea65-4df1-abb3-0428630a211d" returned: 0 in 0.680s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Lock "cinder-quobyte-334d8edf-ea65-4df1-abb3-0428630a211d" released by "delete_volume" :: held 1.579s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Created reservations ['b59da38d-640f-4ca9-9617-a442440db7dd', 'e24b4c8e-21fb-4882-b95c-027907fa0e17', '3b7ac88a-c9fe-4482-9b5a-826bcaded90c', 'b991c395-0921-42a8-9b76-245d7e461697'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:02 devstack sudo[84151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:14:02 devstack sudo[84151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:02 devstack sudo[84151]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.917s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:02 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:14:02 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Deleted volume successfully. Apr 10 12:14:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-67fb9f1c-22a8-4580-a8f5-323da990877b tempest-DeleteServersTestJSON-1002058408 None] Lock "cinder-334d8edf-ea65-4df1-abb3-0428630a211d-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Flow 'volume_create_manager' (3d059829-6a42-4f72-8f37-6658c42b82b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fb705e-8485-46ce-8660-2ce2d2a670ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fb705e-8485-46ce-8660-2ce2d2a670ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1995723986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb76fe9-2d31-47e9-a938-5d686c159ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70aa42ad04b14abfb37649ac77e8d04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:10Z,use_quota=True,user_id='a2dc962a60ea4a9fad7c7ff7aff96392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf8f6ba-4b11-4595-a509-9648fac6b13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (faf8f6ba-4b11-4595-a509-9648fac6b13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63ef9cf-d2ba-4d0b-b350-bf10f72891f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d63ef9cf-d2ba-4d0b-b350-bf10f72891f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cb76fe9-2d31-47e9-a938-5d686c159ac3', 'volume_name': 'volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b61e055-f740-4a52-aca8-6484afdc87de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b61e055-f740-4a52-aca8-6484afdc87de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4575ec98-cec2-45cf-9d82-d98f8c19276b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:10 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Volume 9cb76fe9-2d31-47e9-a938-5d686c159ac3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3', 'volume_size': 1} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1995723986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cb76fe9-2d31-47e9-a938-5d686c159ac3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70aa42ad04b14abfb37649ac77e8d04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:10Z,use_quota=True,user_id='a2dc962a60ea4a9fad7c7ff7aff96392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Creating volume 9cb76fe9-2d31-47e9-a938-5d686c159ac3 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:14:10 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:14:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:10 devstack sudo[84207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 1073741824 Apr 10 12:14:10 devstack sudo[84207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:11 devstack sudo[84207]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 1073741824" returned: 0 in 0.866s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:11 devstack sudo[84224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 Apr 10 12:14:11 devstack sudo[84224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:12 devstack sudo[84224]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3" returned: 0 in 0.577s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:14:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4575ec98-cec2-45cf-9d82-d98f8c19276b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c911183-bfa3-42e7-aa5d-42f6af965d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:12 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Volume volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 (9cb76fe9-2d31-47e9-a938-5d686c159ac3): created successfully Apr 10 12:14:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c911183-bfa3-42e7-aa5d-42f6af965d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Flow 'volume_create_manager' (3d059829-6a42-4f72-8f37-6658c42b82b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:12 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-be9cd256-c82b-4c22-9ca9-12993a493876 tempest-ServersNegativeTestJSON-277594270 None] Created volume successfully. Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:14 devstack sudo[84229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:14:14 devstack sudo[84229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Flow 'volume_create_manager' (895db17b-6985-4a06-ac83-3f8a0b4670aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a75125-729b-4620-bade-d351fa960b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a75125-729b-4620-bade-d351fa960b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1364058213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43239b14-6645-41ec-ace6-40b9e8a1b92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70aa42ad04b14abfb37649ac77e8d04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:15Z,use_quota=True,user_id='a2dc962a60ea4a9fad7c7ff7aff96392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8249fc44-e4b4-4e91-a325-d9aa09b8af6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8249fc44-e4b4-4e91-a325-d9aa09b8af6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95faccd9-db38-4f18-a81e-84949cd111ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95faccd9-db38-4f18-a81e-84949cd111ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43239b14-6645-41ec-ace6-40b9e8a1b92a', 'volume_name': 'volume-43239b14-6645-41ec-ace6-40b9e8a1b92a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee131d8-74c8-43a2-b7b6-2f9a62b2bc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ee131d8-74c8-43a2-b7b6-2f9a62b2bc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbeef4e-8d0c-43e7-b362-c694e69a1501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:14 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Volume 43239b14-6645-41ec-ace6-40b9e8a1b92a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43239b14-6645-41ec-ace6-40b9e8a1b92a', 'volume_size': 1} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1364058213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43239b14-6645-41ec-ace6-40b9e8a1b92a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70aa42ad04b14abfb37649ac77e8d04f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:15Z,use_quota=True,user_id='a2dc962a60ea4a9fad7c7ff7aff96392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Creating volume 43239b14-6645-41ec-ace6-40b9e8a1b92a {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:14:14 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:14:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:14 devstack sudo[84231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a 1073741824 Apr 10 12:14:14 devstack sudo[84231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:15 devstack sudo[84229]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.063s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:15 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:14:15 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1588be72-edc7-4c8a-8bbb-1b778e06e39e tempest-GroupsTest-1921818198 None] Group tempest-Group1-792294152: creating Apr 10 12:14:15 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1588be72-edc7-4c8a-8bbb-1b778e06e39e tempest-GroupsTest-1921818198 None] Group tempest-Group1-792294152: created successfully Apr 10 12:14:15 devstack sudo[84231]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:15 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1588be72-edc7-4c8a-8bbb-1b778e06e39e tempest-GroupsTest-1921818198 None] Create group completed successfully. Apr 10 12:14:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a 1073741824" returned: 0 in 0.740s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:15 devstack sudo[84237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a Apr 10 12:14:15 devstack sudo[84237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:16 devstack sudo[84237]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a" returned: 0 in 0.529s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:14:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddbeef4e-8d0c-43e7-b362-c694e69a1501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43239b14-6645-41ec-ace6-40b9e8a1b92a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916917ae-04b4-4954-a255-0775af1247e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:16 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Volume volume-43239b14-6645-41ec-ace6-40b9e8a1b92a (43239b14-6645-41ec-ace6-40b9e8a1b92a): created successfully Apr 10 12:14:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (916917ae-04b4-4954-a255-0775af1247e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Flow 'volume_create_manager' (895db17b-6985-4a06-ac83-3f8a0b4670aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2f7635fe-cf41-4411-970b-c57e12229ba3 tempest-ServersNegativeTestJSON-277594270 None] Created volume successfully. Apr 10 12:14:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-12d8f5fc-673a-4815-bbce-510e93da24b1 tempest-GroupsTest-1921818198 None] Group tempest-Group2-1492685720: creating Apr 10 12:14:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-12d8f5fc-673a-4815-bbce-510e93da24b1 tempest-GroupsTest-1921818198 None] Group tempest-Group2-1492685720: created successfully Apr 10 12:14:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-12d8f5fc-673a-4815-bbce-510e93da24b1 tempest-GroupsTest-1921818198 None] Create group completed successfully. Apr 10 12:14:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "cinder-43239b14-6645-41ec-ace6-40b9e8a1b92a-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Lock "cinder-43239b14-6645-41ec-ace6-40b9e8a1b92a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "cinder-quobyte-43239b14-6645-41ec-ace6-40b9e8a1b92a" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Lock "cinder-quobyte-43239b14-6645-41ec-ace6-40b9e8a1b92a" acquired by "delete_volume" :: waited 0.028s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:17 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51c9794-f92a-40dd-a50c-d7fa603eac46]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:17 devstack sudo[84247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a Apr 10 12:14:17 devstack sudo[84247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:18 devstack sudo[84247]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a" returned: 0 in 0.812s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:18 devstack sudo[84252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a Apr 10 12:14:18 devstack sudo[84252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Flow 'volume_create_manager' (493cc665-bbab-482a-806a-17c411fa8afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9839975-1564-463a-bdf9-83e1c85219b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9839975-1564-463a-bdf9-83e1c85219b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839882547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7216f60-ebb2-4e9d-890c-7e3cac3ea1e0,host='devstack@QuobyteHD#QuobyteHD',id=56c2be4f-9d49-4d31-acdb-68ef0b6b82c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a13cbedb97241e486cc70090ac8e2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:18Z,use_quota=True,user_id='1df2af961cf4424094d84b5ee4d003dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bab343eb-f9c9-4042-aff9-7a7032fb66c7),volume_type_id=bab343eb-f9c9-4042-aff9-7a7032fb66c7)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9880c3a9-7b19-48ab-a408-87b67e909f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9880c3a9-7b19-48ab-a408-87b67e909f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3340a2-9e90-42d6-a140-6335e5fb340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee3340a2-9e90-42d6-a140-6335e5fb340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c2be4f-9d49-4d31-acdb-68ef0b6b82c5', 'volume_name': 'volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b669c7e-934c-4723-82f1-5df110f9adca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b669c7e-934c-4723-82f1-5df110f9adca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76fb838-bf82-48d9-ab10-44f363548dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:18 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Volume 56c2be4f-9d49-4d31-acdb-68ef0b6b82c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5', 'volume_size': 1} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e7216f60-ebb2-4e9d-890c-7e3cac3ea1e0,created_at=2026-04-10T10:14:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1839882547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e7216f60-ebb2-4e9d-890c-7e3cac3ea1e0,host='devstack@QuobyteHD#QuobyteHD',id=56c2be4f-9d49-4d31-acdb-68ef0b6b82c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a13cbedb97241e486cc70090ac8e2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:18Z,use_quota=True,user_id='1df2af961cf4424094d84b5ee4d003dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bab343eb-f9c9-4042-aff9-7a7032fb66c7),volume_type_id=bab343eb-f9c9-4042-aff9-7a7032fb66c7)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Creating volume 56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:14:18 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:18 devstack sudo[84254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 1073741824 Apr 10 12:14:18 devstack sudo[84254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:18 devstack sudo[84252]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43239b14-6645-41ec-ace6-40b9e8a1b92a" returned: 0 in 0.804s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Lock "cinder-quobyte-43239b14-6645-41ec-ace6-40b9e8a1b92a" released by "delete_volume" :: held 1.661s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Created reservations ['2997996f-f1f6-48f0-981e-88e6f213326f', '1fc747e0-7172-4f8f-add4-9da9201260ba', 'c1c08df1-e379-4f88-8a5a-00c9c19c1f57', '78b59b48-a45b-4e34-9a3f-5dafccdd6d62'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:19 devstack sudo[84260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:14:19 devstack sudo[84260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:19 devstack sudo[84254]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 1073741824" returned: 0 in 0.908s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:19 devstack sudo[84264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 Apr 10 12:14:19 devstack sudo[84264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "cinder-9cb76fe9-2d31-47e9-a938-5d686c159ac3-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Lock "cinder-9cb76fe9-2d31-47e9-a938-5d686c159ac3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "cinder-quobyte-9cb76fe9-2d31-47e9-a938-5d686c159ac3" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Lock "cinder-quobyte-9cb76fe9-2d31-47e9-a938-5d686c159ac3" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[739f5eaf-4573-4d8e-8ea5-4280a0385517]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:19 devstack sudo[84266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 Apr 10 12:14:19 devstack sudo[84260]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:19 devstack sudo[84266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.684s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:14:19 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Deleted volume successfully. Apr 10 12:14:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-020ab463-ade8-494e-b43f-062a7fae0f63 tempest-ServersNegativeTestJSON-277594270 None] Lock "cinder-43239b14-6645-41ec-ace6-40b9e8a1b92a-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:20 devstack sudo[84264]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5" returned: 0 in 0.681s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] <== create_volume: return (1670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76fb838-bf82-48d9-ab10-44f363548dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e54a8e-d2b4-42f4-87f6-a16e70aa48bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:20 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Volume volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 (56c2be4f-9d49-4d31-acdb-68ef0b6b82c5): created successfully Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e54a8e-d2b4-42f4-87f6-a16e70aa48bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Flow 'volume_create_manager' (493cc665-bbab-482a-806a-17c411fa8afc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:20 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-15d73305-7b26-4091-b45d-eb4480d26700 tempest-GroupsTest-1921818198 None] Created volume successfully. Apr 10 12:14:20 devstack sudo[84266]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3" returned: 0 in 0.707s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:20 devstack sudo[84273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3 Apr 10 12:14:20 devstack sudo[84273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:21 devstack sudo[84273]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9cb76fe9-2d31-47e9-a938-5d686c159ac3" returned: 0 in 0.719s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Lock "cinder-quobyte-9cb76fe9-2d31-47e9-a938-5d686c159ac3" released by "delete_volume" :: held 1.470s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Acquiring lock "cinder-quobyte-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Lock "cinder-quobyte-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5" acquired by "delete_volume" :: waited 0.029s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ede4cba-bae0-445e-ad26-eb62434dec17]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Created reservations ['5e0a4a1a-6fbd-42b0-8c72-6f389e24740c', '6415d865-6864-4bed-bd7f-e15c0efc2419', '7d6cfd3a-fa36-4b19-93d5-6bf89843ca7f', 'e5596d7e-388c-4200-b10d-48963ee128be'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:21 devstack sudo[84279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:14:21 devstack sudo[84279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:21 devstack sudo[84278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 Apr 10 12:14:21 devstack sudo[84278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:21 devstack sudo[84279]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.621s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:21 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:14:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Deleted volume successfully. Apr 10 12:14:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f64f5f77-aac8-4ccb-99e1-5faf532abba0 tempest-ServersNegativeTestJSON-277594270 None] Lock "cinder-9cb76fe9-2d31-47e9-a938-5d686c159ac3-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:22 devstack sudo[84278]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5" returned: 0 in 0.913s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:22 devstack sudo[84287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5 Apr 10 12:14:22 devstack sudo[84287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:22 devstack sudo[84287]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5" returned: 0 in 0.632s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Lock "cinder-quobyte-56c2be4f-9d49-4d31-acdb-68ef0b6b82c5" released by "delete_volume" :: held 1.569s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:22 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Created reservations ['cb8741f7-d030-42ce-b006-fd1182bc0f3f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:23 devstack cinder-volume[82546]: WARNING cinder.quota [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-578558066 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-578558066, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:14:23 devstack cinder-volume[82546]: WARNING cinder.quota [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-578558066 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-578558066, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Created reservations ['be2f6fdf-8ff8-464a-beba-d1def3776790', 'd759c4d2-b13e-449a-8d18-4ce9ba99cb43', '03168ec0-df2b-4df2-9b64-fa11c2b85359', 'ffe05267-f5c0-465f-90aa-4454b719e8fa'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:23 devstack sudo[84301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:14:23 devstack sudo[84301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Flow 'volume_create_manager' (eb86df1e-f94d-4b4c-af17-0d5b9800fef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1b746b-fb5b-42ba-a45e-3618c78f69b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f1b746b-fb5b-42ba-a45e-3618c78f69b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:23Z,deleted=False,deleted_at=None,display_description='',display_name='ebedc195-1474-4a29-8002-948852ad333a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d412c730-cc73-4037-8e68-a1d116934479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd81fcd108b148789795b4aeee092d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:23Z,use_quota=True,user_id='9282d89361de4058b7eebf4c40f24117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d714df40-9bcb-4183-984c-ee7933379374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d714df40-9bcb-4183-984c-ee7933379374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adfd7cf-2655-46ef-9d54-548132ca825a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adfd7cf-2655-46ef-9d54-548132ca825a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd412c730-cc73-4037-8e68-a1d116934479', 'volume_name': 'volume-d412c730-cc73-4037-8e68-a1d116934479', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248f60e0-7bae-44c8-b1eb-8b5ea2bab658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (248f60e0-7bae-44c8-b1eb-8b5ea2bab658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34546518-4770-46c4-b61c-ea620a092911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:23 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Volume d412c730-cc73-4037-8e68-a1d116934479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d412c730-cc73-4037-8e68-a1d116934479', 'volume_size': 1} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:23Z,deleted=False,deleted_at=None,display_description='',display_name='ebedc195-1474-4a29-8002-948852ad333a-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d412c730-cc73-4037-8e68-a1d116934479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd81fcd108b148789795b4aeee092d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:23Z,use_quota=True,user_id='9282d89361de4058b7eebf4c40f24117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Creating volume d412c730-cc73-4037-8e68-a1d116934479 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:14:23 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:23 devstack sudo[84322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 1073741824 Apr 10 12:14:23 devstack sudo[84322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Created reservations ['e7c8d720-9f0f-407a-a043-c773acd178f4'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:23 devstack sudo[84324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:14:23 devstack sudo[84324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:24 devstack sudo[84301]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.846s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:24 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:14:24 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b884629b-c80c-423b-ad46-45d2facea9a8 tempest-GroupsTest-1921818198 None] Delete group completed successfully. Apr 10 12:14:24 devstack sudo[84324]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.812s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:24 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:14:24 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f41a2da2-092c-4f80-9bd0-2b8f9509a0d1 tempest-GroupsTest-1921818198 None] Delete group completed successfully. Apr 10 12:14:24 devstack sudo[84322]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 1073741824" returned: 0 in 1.111s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:24 devstack sudo[84339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 Apr 10 12:14:24 devstack sudo[84339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:25 devstack sudo[84339]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479" returned: 0 in 0.658s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:14:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34546518-4770-46c4-b61c-ea620a092911) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d412c730-cc73-4037-8e68-a1d116934479', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ff9b32-056c-499e-98e7-f2008b974de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:25 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6d79166f-7c1f-49af-a480-ee7040e2326a tempest-GroupsTest-1921818198 None] Group tempest-GroupsTest-Group-1356003111: creating Apr 10 12:14:25 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Volume volume-d412c730-cc73-4037-8e68-a1d116934479 (d412c730-cc73-4037-8e68-a1d116934479): created successfully Apr 10 12:14:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3ff9b32-056c-499e-98e7-f2008b974de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Flow 'volume_create_manager' (eb86df1e-f94d-4b4c-af17-0d5b9800fef1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:25 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-d9e1c6ed-b140-4290-b865-286afa001d5d tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Created volume successfully. Apr 10 12:14:25 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6d79166f-7c1f-49af-a480-ee7040e2326a tempest-GroupsTest-1921818198 None] Group tempest-GroupsTest-Group-1356003111: created successfully Apr 10 12:14:25 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6d79166f-7c1f-49af-a480-ee7040e2326a tempest-GroupsTest-1921818198 None] Create group completed successfully. Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:UPDATE=67,cinder:SELECT=53,cinder:INSERT=15,cinder:DELETE=4 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=64,cinder:UPDATE=68,cinder:INSERT=13,cinder:DELETE=6 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Flow 'volume_create_manager' (fd178bb6-7ec8-493c-b996-1ae43e7ed584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48feff34-bf31-46b7-9881-144b2817c432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-ebce0465-d261-414f-9de6-6fbd5733b3f8 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-ebce0465-d261-414f-9de6-6fbd5733b3f8 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48feff34-bf31-46b7-9881-144b2817c432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-681409783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e131ae-e24e-43ff-b6f1-787e0a2b3198,host='devstack@QuobyteHD#QuobyteHD',id=98c1d7d9-f861-479a-9fd2-2c72864aa23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a13cbedb97241e486cc70090ac8e2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:27Z,use_quota=True,user_id='1df2af961cf4424094d84b5ee4d003dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceb8c93a-1e18-4cc2-9541-99d5bd133489),volume_type_id=ceb8c93a-1e18-4cc2-9541-99d5bd133489)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f532ec-8762-44f4-8113-3bfe922021a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f532ec-8762-44f4-8113-3bfe922021a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2562165-697e-4cf2-b519-b4135b9211d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2562165-697e-4cf2-b519-b4135b9211d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c1d7d9-f861-479a-9fd2-2c72864aa23c', 'volume_name': 'volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8100ab-87a5-4a8a-bc19-56e112015c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8100ab-87a5-4a8a-bc19-56e112015c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7314a6f7-c463-4efb-b59b-3333ffc639b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:26 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Volume 98c1d7d9-f861-479a-9fd2-2c72864aa23c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c', 'volume_size': 1} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba78cff-7e2c-4b4c-94f2-b713ce54a4ec]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-ebce0465-d261-414f-9de6-6fbd5733b3f8 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:26 devstack sudo[84370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 Apr 10 12:14:26 devstack sudo[84370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:27 devstack sudo[84370]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-ebce0465-d261-414f-9de6-6fbd5733b3f8 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479" returned: 0 in 0.492s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-ebce0465-d261-414f-9de6-6fbd5733b3f8 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.537s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.505s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22e131ae-e24e-43ff-b6f1-787e0a2b3198,created_at=2026-04-10T10:14:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-681409783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e131ae-e24e-43ff-b6f1-787e0a2b3198,host='devstack@QuobyteHD#QuobyteHD',id=98c1d7d9-f861-479a-9fd2-2c72864aa23c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a13cbedb97241e486cc70090ac8e2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:27Z,use_quota=True,user_id='1df2af961cf4424094d84b5ee4d003dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceb8c93a-1e18-4cc2-9541-99d5bd133489),volume_type_id=ceb8c93a-1e18-4cc2-9541-99d5bd133489)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Creating volume 98c1d7d9-f861-479a-9fd2-2c72864aa23c {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:14:27 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:27 devstack sudo[84375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c 1073741824 Apr 10 12:14:27 devstack sudo[84375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-ebce0465-d261-414f-9de6-6fbd5733b3f8 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196', 'name': 'volume-d412c730-cc73-4037-8e68-a1d116934479', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2f002bd9-00f1-4917-8915-6c35bb78d559', 'enforce_multipath': True} {{(pid=82546) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 12:14:27 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-b92f6ff9-07f3-4bb0-878b-6bb18afbdd56 req-ebce0465-d261-414f-9de6-6fbd5733b3f8 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] attachment_update completed successfully. Apr 10 12:14:28 devstack sudo[84375]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c 1073741824" returned: 0 in 0.578s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:28 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c Apr 10 12:14:28 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:28 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7314a6f7-c463-4efb-b59b-3333ffc639b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbb2653-52ed-4995-a95a-bcbc07e37f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:28 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Volume volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c (98c1d7d9-f861-479a-9fd2-2c72864aa23c): created successfully Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbb2653-52ed-4995-a95a-bcbc07e37f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Flow 'volume_create_manager' (fd178bb6-7ec8-493c-b996-1ae43e7ed584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f22fbd5b-6f94-4128-b9a6-2b3e028777b1 tempest-GroupsTest-1921818198 None] Created volume successfully. Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Flow 'volume_create_manager' (a97597ac-1c5f-49a3-89cf-d7cfe47710b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3763b5e-4b3c-4c35-8339-46479509e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3763b5e-4b3c-4c35-8339-46479509e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-411417501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e131ae-e24e-43ff-b6f1-787e0a2b3198,host='devstack@QuobyteHD#QuobyteHD',id=b091c0f5-de88-4d57-975c-0d1b5f5af71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a13cbedb97241e486cc70090ac8e2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:29Z,use_quota=True,user_id='1df2af961cf4424094d84b5ee4d003dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceb8c93a-1e18-4cc2-9541-99d5bd133489),volume_type_id=ceb8c93a-1e18-4cc2-9541-99d5bd133489)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93987fec-e2a8-465f-b6b1-1a0bf4e64aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93987fec-e2a8-465f-b6b1-1a0bf4e64aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f183ca0-85de-4b75-b8b1-41fa486efbfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f183ca0-85de-4b75-b8b1-41fa486efbfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b091c0f5-de88-4d57-975c-0d1b5f5af71f', 'volume_name': 'volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5fc3e4-debc-4ea3-9122-0afa4de13d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b5fc3e4-debc-4ea3-9122-0afa4de13d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d54ed5-4a47-41f4-9c47-abe3aab1a688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:29 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Volume b091c0f5-de88-4d57-975c-0d1b5f5af71f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f', 'volume_size': 1} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=22e131ae-e24e-43ff-b6f1-787e0a2b3198,created_at=2026-04-10T10:14:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-411417501',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=22e131ae-e24e-43ff-b6f1-787e0a2b3198,host='devstack@QuobyteHD#QuobyteHD',id=b091c0f5-de88-4d57-975c-0d1b5f5af71f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0a13cbedb97241e486cc70090ac8e2ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:29Z,use_quota=True,user_id='1df2af961cf4424094d84b5ee4d003dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ceb8c93a-1e18-4cc2-9541-99d5bd133489),volume_type_id=ceb8c93a-1e18-4cc2-9541-99d5bd133489)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Creating volume b091c0f5-de88-4d57-975c-0d1b5f5af71f {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:14:29 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:14:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:29 devstack sudo[84384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f 1073741824 Apr 10 12:14:29 devstack sudo[84384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:30 devstack sudo[84384]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f 1073741824" returned: 0 in 0.778s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:30 devstack sudo[84461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f Apr 10 12:14:30 devstack sudo[84461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:30 devstack sudo[84461]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f" returned: 0 in 0.576s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.394s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d54ed5-4a47-41f4-9c47-abe3aab1a688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06409964-05df-4e15-afc9-0c0a74a5921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:30 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Volume volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f (b091c0f5-de88-4d57-975c-0d1b5f5af71f): created successfully Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06409964-05df-4e15-afc9-0c0a74a5921b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Flow 'volume_create_manager' (a97597ac-1c5f-49a3-89cf-d7cfe47710b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:30 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-89994889-f10f-43f0-9d30-0eb571ac0b87 tempest-GroupsTest-1921818198 None] Created volume successfully. Apr 10 12:14:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-afdc427a-bafe-4a14-bfa0-1ed652c62ea7 tempest-GroupsTest-1921818198 None] Update group completed successfully. Apr 10 12:14:33 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-388f7fae-b29a-4fa4-9386-26b2fe9db1d8 tempest-GroupsTest-1921818198 None] Update group completed successfully. Apr 10 12:14:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Acquiring lock "cinder-quobyte-98c1d7d9-f861-479a-9fd2-2c72864aa23c" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Lock "cinder-quobyte-98c1d7d9-f861-479a-9fd2-2c72864aa23c" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:35 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ce8a8e-93fd-4205-bc85-1dd000b1f39f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:35 devstack sudo[84841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c Apr 10 12:14:35 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:36 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c" returned: 0 in 0.943s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:36 devstack sudo[84870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c Apr 10 12:14:36 devstack sudo[84870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:36 devstack sudo[84870]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-98c1d7d9-f861-479a-9fd2-2c72864aa23c" returned: 0 in 0.668s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Lock "cinder-quobyte-98c1d7d9-f861-479a-9fd2-2c72864aa23c" released by "delete_volume" :: held 1.729s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Acquiring lock "cinder-quobyte-b091c0f5-de88-4d57-975c-0d1b5f5af71f" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Lock "cinder-quobyte-b091c0f5-de88-4d57-975c-0d1b5f5af71f" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:36 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[89563c2a-acbe-4655-a769-5e03eced1625]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:36 devstack sudo[84878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f Apr 10 12:14:36 devstack sudo[84878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:37 devstack sudo[84878]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f" returned: 0 in 0.595s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:37 devstack sudo[84886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f Apr 10 12:14:37 devstack sudo[84886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:37 devstack sudo[84886]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b091c0f5-de88-4d57-975c-0d1b5f5af71f" returned: 0 in 0.469s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Lock "cinder-quobyte-b091c0f5-de88-4d57-975c-0d1b5f5af71f" released by "delete_volume" :: held 1.101s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:37 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Created reservations ['c830b9b3-f5ea-4f2c-88e2-970bdd7e576b'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:38 devstack cinder-volume[82546]: WARNING cinder.quota [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1181920152 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1181920152, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:14:38 devstack cinder-volume[82546]: WARNING cinder.quota [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1181920152 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1181920152, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:14:38 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Created reservations ['265976c7-b617-43b0-bbb0-b1516bd88ef6', '07fe6f27-e64f-46de-b0e5-371f9c8a11f5', 'a477c5a0-6da5-40c2-858e-9d2bfd06c058', '278a03d0-0ad7-47dd-8c42-cd38979bc450'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:38 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Created reservations ['3bbf1893-357f-496d-af7b-13e77a685b80', '0309c3a7-e664-423e-a2a3-3bea730027cd', 'a1bd65fe-24ff-4dac-8c9a-6a1e2062cc07', '108c0993-a578-4b08-b609-1049052b1d04'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:38 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:14:38 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:39 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.802s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:14:39 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-5a29cba9-a5e1-4979-9845-43388c07ade1 tempest-GroupsTest-1921818198 None] Delete group completed successfully. Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Flow 'volume_create_manager' (a0452da7-e4e6-4458-a82a-6edcd25bc4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6d7383-8e0c-4a6a-b4bc-509617f2c8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6d7383-8e0c-4a6a-b4bc-509617f2c8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2014568471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555577f1-2fa2-4ae1-8593-6d927266490f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1437ba91983444e099d219380c2b0009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:40Z,use_quota=True,user_id='f3ca9f11501e4f38b2b77311b28098e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11062526-a71b-4279-84ab-4edec8694f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11062526-a71b-4279-84ab-4edec8694f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e7c8f3-cdef-4be7-8617-7c1b80959487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27e7c8f3-cdef-4be7-8617-7c1b80959487) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '555577f1-2fa2-4ae1-8593-6d927266490f', 'volume_name': 'volume-555577f1-2fa2-4ae1-8593-6d927266490f', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa2cebc-3eb8-4030-8950-339954d6a05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa2cebc-3eb8-4030-8950-339954d6a05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04842535-b5d1-44cf-bd77-6aa1fdcc50cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:39 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Volume 555577f1-2fa2-4ae1-8593-6d927266490f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-555577f1-2fa2-4ae1-8593-6d927266490f', 'volume_size': 1} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2014568471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=555577f1-2fa2-4ae1-8593-6d927266490f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1437ba91983444e099d219380c2b0009',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:40Z,use_quota=True,user_id='f3ca9f11501e4f38b2b77311b28098e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Creating volume 555577f1-2fa2-4ae1-8593-6d927266490f {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:14:39 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:14:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:39 devstack sudo[84931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f 1073741824 Apr 10 12:14:39 devstack sudo[84931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:40 devstack sudo[84931]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f 1073741824" returned: 0 in 1.014s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:40 devstack sudo[84946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f Apr 10 12:14:40 devstack sudo[84946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:41 devstack sudo[84946]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f" returned: 0 in 0.615s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:14:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04842535-b5d1-44cf-bd77-6aa1fdcc50cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-555577f1-2fa2-4ae1-8593-6d927266490f', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7e7f3b-931f-4f83-b8f3-303af052745d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Volume volume-555577f1-2fa2-4ae1-8593-6d927266490f (555577f1-2fa2-4ae1-8593-6d927266490f): created successfully Apr 10 12:14:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f7e7f3b-931f-4f83-b8f3-303af052745d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Flow 'volume_create_manager' (a0452da7-e4e6-4458-a82a-6edcd25bc4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-3a837879-67bb-4113-9476-6ee010bb2eb6 req-ca996bd0-5f82-46cc-9854-a74efbcf680a tempest-VolumesSnapshotsTestJSON-851099847 None] Created volume successfully. Apr 10 12:14:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Creating offline snapshot 22ce98e0-975d-458f-b001-29fb74b5cebf of volume 555577f1-2fa2-4ae1-8593-6d927266490f {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:14:42 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e195966d-0ccc-4164-9b25-ad7995578769]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:42 devstack sudo[84972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f Apr 10 12:14:42 devstack sudo[84972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:44 devstack sudo[84972]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f" returned: 0 in 1.653s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:44 devstack sudo[85000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf 1G Apr 10 12:14:44 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:45 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf 1G" returned: 0 in 0.933s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-555577f1-2fa2-4ae1-8593-6d927266490f -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:45 devstack sudo[85011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-555577f1-2fa2-4ae1-8593-6d927266490f -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf Apr 10 12:14:45 devstack sudo[85011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:45 devstack sudo[85011]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-555577f1-2fa2-4ae1-8593-6d927266490f -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf" returned: 0 in 0.678s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:45 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf is being set with open permissions: ugo+rw Apr 10 12:14:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:45 devstack sudo[85016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf Apr 10 12:14:45 devstack sudo[85016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:46 devstack sudo[85016]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf" returned: 0 in 0.673s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:46 devstack sudo[85019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.info Apr 10 12:14:46 devstack sudo[85019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:47 devstack sudo[85019]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.info" returned: 0 in 0.733s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:47 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.info is being set with open permissions: ugo+rw Apr 10 12:14:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:47 devstack sudo[85056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.info Apr 10 12:14:47 devstack sudo[85056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:47 devstack sudo[85056]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.info" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.294s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-a72300b3-9eea-47a9-9557-39bdf6930d0d req-165195eb-614b-458e-abf4-b0da25faa171 tempest-VolumesSnapshotsTestJSON-851099847 None] Create snapshot completed successfully Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "cinder-22ce98e0-975d-458f-b001-29fb74b5cebf-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-22ce98e0-975d-458f-b001-29fb74b5cebf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "cinder-quobyte-555577f1-2fa2-4ae1-8593-6d927266490f" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-quobyte-555577f1-2fa2-4ae1-8593-6d927266490f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "cinder-quobyte-22ce98e0-975d-458f-b001-29fb74b5cebf" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-quobyte-22ce98e0-975d-458f-b001-29fb74b5cebf" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Deleting offline snapshot 22ce98e0-975d-458f-b001-29fb74b5cebf of volume 555577f1-2fa2-4ae1-8593-6d927266490f {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] snapshot_file for this snap is: volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[95971021-cc00-46de-b9ea-12b86e48b344]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:49 devstack sudo[85109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf Apr 10 12:14:49 devstack sudo[85109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:50 devstack sudo[85109]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf" returned: 0 in 0.840s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-555577f1-2fa2-4ae1-8593-6d927266490f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:14:50 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ebef1d-b781-46c1-aa9b-36483298c02d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:50 devstack sudo[85165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f Apr 10 12:14:50 devstack sudo[85165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:50 devstack sudo[85165]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f" returned: 0 in 0.575s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:50 devstack sudo[85171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf Apr 10 12:14:50 devstack sudo[85171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:51 devstack sudo[85171]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf" returned: 0 in 1.094s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:51 devstack sudo[85178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf Apr 10 12:14:51 devstack sudo[85178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:53 devstack sudo[85178]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f.22ce98e0-975d-458f-b001-29fb74b5cebf" returned: 0 in 1.396s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-quobyte-22ce98e0-975d-458f-b001-29fb74b5cebf" released by "_delete_snapshot" :: held 4.022s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-quobyte-555577f1-2fa2-4ae1-8593-6d927266490f" released by "delete_snapshot" :: held 4.092s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:53 devstack cinder-volume[82546]: WARNING cinder.quota [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG cinder.quota [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Created reservations ['dea9f7ce-0145-4978-8eec-48e93299c03a', '25f71cbc-55f5-4367-8f68-b8ab13d74136', '820bf1d1-9d64-4142-ae0b-c040aefa86d6', '132c1d85-b67d-4336-98c6-b194049b4724'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:53 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Delete snapshot completed successfully. Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-7963e123-2998-4cf6-951a-64161fe9d2d0 req-78f16641-7127-41f7-ac7e-5ec09eab8418 tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-22ce98e0-975d-458f-b001-29fb74b5cebf-delete_snapshot" released by "delete_snapshot" :: held 4.343s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "cinder-555577f1-2fa2-4ae1-8593-6d927266490f-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-555577f1-2fa2-4ae1-8593-6d927266490f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "cinder-quobyte-555577f1-2fa2-4ae1-8593-6d927266490f" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-quobyte-555577f1-2fa2-4ae1-8593-6d927266490f" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddd76f1-55bd-4455-943f-2daf0606a1aa]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:14:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:54 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f Apr 10 12:14:54 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:54 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f" returned: 0 in 0.863s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:54 devstack sudo[85216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f Apr 10 12:14:54 devstack sudo[85216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:55 devstack sudo[85216]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-555577f1-2fa2-4ae1-8593-6d927266490f" returned: 0 in 0.723s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-quobyte-555577f1-2fa2-4ae1-8593-6d927266490f" released by "delete_volume" :: held 1.717s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG cinder.quota [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Created reservations ['9cbe8798-952f-416f-a19f-d85c8857ec13', 'ee826f15-fb67-4aac-8ef0-8541a0b04aa0', '55273294-07f4-4523-86cd-5383290cf8a7', 'f88380e1-76e3-45aa-8198-c8ae099903ca'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:55 devstack sudo[85239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:14:55 devstack sudo[85239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Flow 'volume_create_manager' (4d58cf01-55f7-4baf-b56f-dcf9b4b122ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a323344-3b5b-451d-b624-652399482c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a323344-3b5b-451d-b624-652399482c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1034913317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b27ddd-bb5b-4a10-97d9-8d36179651a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfacf3de90594591b74c6fd8c197b285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:56Z,use_quota=True,user_id='963e24d5c8d84828b9add9c693cfdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f6189e-09e6-4d62-a753-b3de9902966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99f6189e-09e6-4d62-a753-b3de9902966b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3de99e-b76d-4aa2-b2d4-79e4003e71f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff3de99e-b76d-4aa2-b2d4-79e4003e71f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06b27ddd-bb5b-4a10-97d9-8d36179651a3', 'volume_name': 'volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9889b9a0-efd7-419b-bba0-4c0c8eaef579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9889b9a0-efd7-419b-bba0-4c0c8eaef579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9715f685-8288-4566-b515-58f45d343ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:56 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Volume 06b27ddd-bb5b-4a10-97d9-8d36179651a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3', 'volume_size': 1} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:14:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1034913317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06b27ddd-bb5b-4a10-97d9-8d36179651a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bfacf3de90594591b74c6fd8c197b285',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:14:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:14:56Z,use_quota=True,user_id='963e24d5c8d84828b9add9c693cfdcaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Creating volume 06b27ddd-bb5b-4a10-97d9-8d36179651a3 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:14:56 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:14:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:56 devstack sudo[85262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 1073741824 Apr 10 12:14:56 devstack sudo[85262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:57 devstack sudo[85239]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.678s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:57 devstack cinder-volume[82546]: DEBUG cinder.manager [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:14:57 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Deleted volume successfully. Apr 10 12:14:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-c2bf0427-a91a-479f-bcc2-527638d8e0e9 req-387d2731-ee08-41ba-97c5-060384d464ba tempest-VolumesSnapshotsTestJSON-851099847 None] Lock "cinder-555577f1-2fa2-4ae1-8593-6d927266490f-delete_volume" released by "delete_volume" :: held 3.675s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:14:57 devstack sudo[85262]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 1073741824" returned: 0 in 1.397s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:14:57 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 Apr 10 12:14:57 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:14:58 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 10 12:14:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3" returned: 0 in 1.073s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:14:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] <== create_volume: return (2504ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:14:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.507s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:14:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9715f685-8288-4566-b515-58f45d343ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3648d84e-2e5f-435a-aa13-c7e814666e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:14:59 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Volume volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 (06b27ddd-bb5b-4a10-97d9-8d36179651a3): created successfully Apr 10 12:14:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3648d84e-2e5f-435a-aa13-c7e814666e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:14:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Flow 'volume_create_manager' (4d58cf01-55f7-4baf-b56f-dcf9b4b122ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:14:59 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-58a8bd7a-3e04-46a4-a4aa-b2c323ab4050 tempest-ServerRescueNegativeTestJSON-1231050735 None] Created volume successfully. Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Flow 'volume_create_manager' (f1b9caee-f853-4ae9-84af-ccc63758e0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e066de2f-d6f8-405e-a430-ab4670f61848) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e066de2f-d6f8-405e-a430-ab4670f61848) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-14225611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635d1622-3c28-455c-9948-d6d6efef43ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2cb74b340874f3e9848e409105f128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:05Z,use_quota=True,user_id='d47fabd6e68242e08d69bc4cb912e715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de73f506-af44-402b-9518-81d5dd56e449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de73f506-af44-402b-9518-81d5dd56e449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd586189-45cf-48b7-9ebd-004b798b70a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd586189-45cf-48b7-9ebd-004b798b70a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635d1622-3c28-455c-9948-d6d6efef43ba', 'volume_name': 'volume-635d1622-3c28-455c-9948-d6d6efef43ba', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3113b6-0230-4bf1-a3aa-33304c7236c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee3113b6-0230-4bf1-a3aa-33304c7236c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74950155-2532-410d-a704-f6aaa55fdc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:04 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Volume 635d1622-3c28-455c-9948-d6d6efef43ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635d1622-3c28-455c-9948-d6d6efef43ba', 'volume_size': 1} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-14225611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635d1622-3c28-455c-9948-d6d6efef43ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2cb74b340874f3e9848e409105f128c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:05Z,use_quota=True,user_id='d47fabd6e68242e08d69bc4cb912e715',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Creating volume 635d1622-3c28-455c-9948-d6d6efef43ba {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:04 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:04 devstack sudo[85330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba 1073741824 Apr 10 12:15:04 devstack sudo[85330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:05 devstack sudo[85330]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba 1073741824" returned: 0 in 0.768s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:05 devstack sudo[85338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba Apr 10 12:15:05 devstack sudo[85338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:06 devstack sudo[85338]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba" returned: 0 in 0.674s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74950155-2532-410d-a704-f6aaa55fdc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635d1622-3c28-455c-9948-d6d6efef43ba', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e97b06-a02a-431f-acc0-3e056e25b5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:06 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Volume volume-635d1622-3c28-455c-9948-d6d6efef43ba (635d1622-3c28-455c-9948-d6d6efef43ba): created successfully Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e97b06-a02a-431f-acc0-3e056e25b5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Flow 'volume_create_manager' (f1b9caee-f853-4ae9-84af-ccc63758e0c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:06 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-eb715634-3848-4bd2-8e7c-165ad58697d8 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Created volume successfully. Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Creating offline snapshot 9236de27-36d0-4724-83a5-a8a3c96f9f12 of volume 635d1622-3c28-455c-9948-d6d6efef43ba {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[efae38d0-168c-427f-8bf5-cb2d2e527d81]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:07 devstack sudo[85347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba Apr 10 12:15:07 devstack sudo[85347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:07 devstack sudo[85347]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba" returned: 0 in 0.646s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:07 devstack sudo[85368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 1G Apr 10 12:15:07 devstack sudo[85368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:08 devstack sudo[85368]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 1G" returned: 0 in 0.654s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635d1622-3c28-455c-9948-d6d6efef43ba -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:08 devstack sudo[85374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635d1622-3c28-455c-9948-d6d6efef43ba -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 Apr 10 12:15:08 devstack sudo[85374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:08 devstack sudo[85374]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-635d1622-3c28-455c-9948-d6d6efef43ba -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12" returned: 0 in 0.463s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:08 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 is being set with open permissions: ugo+rw Apr 10 12:15:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:08 devstack sudo[85379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 Apr 10 12:15:08 devstack sudo[85379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:09 devstack sudo[85379]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12" returned: 0 in 0.858s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:09 devstack sudo[85412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.info Apr 10 12:15:09 devstack sudo[85412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:10 devstack sudo[85412]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.info" returned: 0 in 1.409s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:11 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.info is being set with open permissions: ugo+rw Apr 10 12:15:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:11 devstack sudo[85419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.info Apr 10 12:15:11 devstack sudo[85419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:11 devstack sudo[85419]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.info" returned: 0 in 0.842s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.999s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b65f7d21-f670-4d8a-a0d3-35e6862a6a78 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Create snapshot completed successfully Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "cinder-9236de27-36d0-4724-83a5-a8a3c96f9f12-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-9236de27-36d0-4724-83a5-a8a3c96f9f12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "cinder-quobyte-635d1622-3c28-455c-9948-d6d6efef43ba" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-quobyte-635d1622-3c28-455c-9948-d6d6efef43ba" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "cinder-quobyte-9236de27-36d0-4724-83a5-a8a3c96f9f12" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-quobyte-9236de27-36d0-4724-83a5-a8a3c96f9f12" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Deleting offline snapshot 9236de27-36d0-4724-83a5-a8a3c96f9f12 of volume 635d1622-3c28-455c-9948-d6d6efef43ba {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] snapshot_file for this snap is: volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fe93b2-3168-405a-b7f9-9dd59b08fe52]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:12 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 Apr 10 12:15:12 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:13 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12" returned: 0 in 0.735s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-635d1622-3c28-455c-9948-d6d6efef43ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:15:13 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b995d3a-9c90-4f0c-8901-2bae241ecccd]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:13 devstack sudo[85460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba Apr 10 12:15:13 devstack sudo[85460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:14 devstack sudo[85482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:14 devstack sudo[85482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:14 devstack sudo[85482]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.890s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:15 devstack sudo[85460]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba" returned: 0 in 1.366s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:15 devstack sudo[85512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 Apr 10 12:15:15 devstack sudo[85512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:16 devstack sudo[85512]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12" returned: 0 in 1.368s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:16 devstack sudo[85521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12 Apr 10 12:15:16 devstack sudo[85521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:17 devstack sudo[85521]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba.9236de27-36d0-4724-83a5-a8a3c96f9f12" returned: 0 in 0.688s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-quobyte-9236de27-36d0-4724-83a5-a8a3c96f9f12" released by "_delete_snapshot" :: held 4.283s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-quobyte-635d1622-3c28-455c-9948-d6d6efef43ba" released by "delete_snapshot" :: held 4.300s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Created reservations ['4839944f-2095-48e1-909a-efcba06d768c', '75c474d5-a84e-4fa9-ae2c-897f2f81601a', '495ee16b-3055-4092-a937-a05f2e2441d2', '37288759-b9af-4a4d-8078-be1152add197'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:17 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Delete snapshot completed successfully. Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-466eb527-247c-42c7-9021-2cbf47abd376 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-9236de27-36d0-4724-83a5-a8a3c96f9f12-delete_snapshot" released by "delete_snapshot" :: held 4.430s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Acquiring lock "cinder-06b27ddd-bb5b-4a10-97d9-8d36179651a3-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "cinder-06b27ddd-bb5b-4a10-97d9-8d36179651a3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Acquiring lock "cinder-quobyte-06b27ddd-bb5b-4a10-97d9-8d36179651a3" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "cinder-quobyte-06b27ddd-bb5b-4a10-97d9-8d36179651a3" acquired by "delete_volume" :: waited 0.032s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65cdaf5-1cdb-423d-9526-932fa1d3b25e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:17 devstack sudo[85526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 Apr 10 12:15:17 devstack sudo[85526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:18 devstack sudo[85526]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3" returned: 0 in 0.780s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:18 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3 Apr 10 12:15:18 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "cinder-635d1622-3c28-455c-9948-d6d6efef43ba-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-635d1622-3c28-455c-9948-d6d6efef43ba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "cinder-quobyte-635d1622-3c28-455c-9948-d6d6efef43ba" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-quobyte-635d1622-3c28-455c-9948-d6d6efef43ba" acquired by "delete_volume" :: waited 0.032s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:18 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d456e129-012f-463d-90b7-701ce1e11ed7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:18 devstack sudo[85533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba Apr 10 12:15:18 devstack sudo[85533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:19 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-06b27ddd-bb5b-4a10-97d9-8d36179651a3" returned: 0 in 1.037s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:19 devstack sudo[85533]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "cinder-quobyte-06b27ddd-bb5b-4a10-97d9-8d36179651a3" released by "delete_volume" :: held 1.888s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba" returned: 0 in 0.832s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:19 devstack sudo[85544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba Apr 10 12:15:19 devstack sudo[85544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Created reservations ['1fdaa21d-edfe-4534-919f-4d73679b6704', '240ae63c-3ba2-488d-822c-1719831d230b', 'aac366a6-5fc9-4820-b3fb-18ba29a8652e', '80d47fa4-1839-4236-86bc-0e014d1fb9cb'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:19 devstack sudo[85550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:19 devstack sudo[85550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:20 devstack sudo[85544]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-635d1622-3c28-455c-9948-d6d6efef43ba" returned: 0 in 1.256s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-quobyte-635d1622-3c28-455c-9948-d6d6efef43ba" released by "delete_volume" :: held 2.179s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:20 devstack sudo[85550]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.158s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:20 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Deleted volume successfully. Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Created reservations ['c2c07172-0f51-4214-953e-987775ef20e7', '430ff7d6-6d6b-4916-83b0-e2038967e3be', '7ccf828e-a594-49d3-8792-4aee9ae71015', 'e08a0a59-3b86-4645-982d-1da30a9cad5b'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70d627ed-3567-44b5-a310-b7e97f822c78 tempest-ServerRescueNegativeTestJSON-1231050735 None] Lock "cinder-06b27ddd-bb5b-4a10-97d9-8d36179651a3-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:20 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:20 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:21 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.779s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:21 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Deleted volume successfully. Apr 10 12:15:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b3f82ccf-266c-4492-8d02-69c700ab93c6 tempest-VolumeSnapshotQuotasNegativeTestJSON-732318944 None] Lock "cinder-635d1622-3c28-455c-9948-d6d6efef43ba-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:22 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Flow 'volume_create_manager' (88d2188e-7f46-473f-8e3d-2e80fbe86dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ffe962-ca41-4954-9031-0adb8423386a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9ffe962-ca41-4954-9031-0adb8423386a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1780929559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a59178-d5b2-4013-8941-3c1467cf3873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba5d02daeb34950930b96c5d75fed95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:23Z,use_quota=True,user_id='bef26f7f462949219e5dd48f88a09844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c385e0d-eeec-4fb5-9ab3-a83e2c65e414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c385e0d-eeec-4fb5-9ab3-a83e2c65e414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e19fd3-227b-4d6f-b12a-a7f13e1b210c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63e19fd3-227b-4d6f-b12a-a7f13e1b210c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a59178-d5b2-4013-8941-3c1467cf3873', 'volume_name': 'volume-54a59178-d5b2-4013-8941-3c1467cf3873', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74547d2-9f63-4432-a2e4-d620924269d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a74547d2-9f63-4432-a2e4-d620924269d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7473b85-2fd6-4753-8312-b8493dad28c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:23 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Volume 54a59178-d5b2-4013-8941-3c1467cf3873: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a59178-d5b2-4013-8941-3c1467cf3873', 'volume_size': 1} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1780929559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a59178-d5b2-4013-8941-3c1467cf3873,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ba5d02daeb34950930b96c5d75fed95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:23Z,use_quota=True,user_id='bef26f7f462949219e5dd48f88a09844',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Creating volume 54a59178-d5b2-4013-8941-3c1467cf3873 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:23 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:23 devstack sudo[85614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 1073741824 Apr 10 12:15:23 devstack sudo[85614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:24 devstack sudo[85614]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 1073741824" returned: 0 in 1.331s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:24 devstack sudo[85622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 Apr 10 12:15:24 devstack sudo[85622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:25 devstack sudo[85622]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873" returned: 0 in 0.729s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.110s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7473b85-2fd6-4753-8312-b8493dad28c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a59178-d5b2-4013-8941-3c1467cf3873', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d324e7e-81cd-465c-a5d2-b9923b0f7ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:25 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Volume volume-54a59178-d5b2-4013-8941-3c1467cf3873 (54a59178-d5b2-4013-8941-3c1467cf3873): created successfully Apr 10 12:15:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d324e7e-81cd-465c-a5d2-b9923b0f7ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Flow 'volume_create_manager' (88d2188e-7f46-473f-8e3d-2e80fbe86dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:25 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f1336786-8733-401f-a29f-c79bb329c8f1 tempest-VolumesServicesTestJSON-651733179 None] Created volume successfully. Apr 10 12:15:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Acquiring lock "cinder-54a59178-d5b2-4013-8941-3c1467cf3873-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Lock "cinder-54a59178-d5b2-4013-8941-3c1467cf3873-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Acquiring lock "cinder-quobyte-54a59178-d5b2-4013-8941-3c1467cf3873" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Lock "cinder-quobyte-54a59178-d5b2-4013-8941-3c1467cf3873" acquired by "delete_volume" :: waited 0.039s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:26 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35f78d9-6292-4288-b05f-08eafdd3b298]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:26 devstack sudo[85629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 Apr 10 12:15:26 devstack sudo[85629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:27 devstack sudo[85629]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873" returned: 0 in 0.642s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:27 devstack sudo[85635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873 Apr 10 12:15:27 devstack sudo[85635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:27 devstack sudo[85635]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-54a59178-d5b2-4013-8941-3c1467cf3873" returned: 0 in 0.592s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Lock "cinder-quobyte-54a59178-d5b2-4013-8941-3c1467cf3873" released by "delete_volume" :: held 1.389s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:27 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=57,cinder:UPDATE=71,cinder:INSERT=12,cinder:DELETE=9 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:15:27 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:UPDATE=87,cinder:SELECT=83,cinder:INSERT=25,cinder:DELETE=2 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:15:27 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Created reservations ['0335e487-4160-4b4d-84e9-b705e4ed41c3', 'f8d392ed-194e-4386-8740-90dcd9ff40e3', 'fee73bae-60ce-4442-930f-79360f6baa95', '2b2474f9-fddd-474d-9213-417eda0885b3'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:28 devstack sudo[85639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:28 devstack sudo[85639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:28 devstack sudo[85639]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.575s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Deleted volume successfully. Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0a632367-1f26-450b-8dda-1ee22bc9128c tempest-VolumesServicesTestJSON-651733179 None] Lock "cinder-54a59178-d5b2-4013-8941-3c1467cf3873-delete_volume" released by "delete_volume" :: held 2.242s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Flow 'volume_create_manager' (eb41452b-1805-49f2-a746-dfb6e0b07849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d273a4-d81d-416b-ae08-1f1c5050944e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d273a4-d81d-416b-ae08-1f1c5050944e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1052046748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c9c066-a43b-495f-9132-bb7ff1feff32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da87369ce4bc4233a1c43fbb8103c3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:29Z,use_quota=True,user_id='ec2470f020fe4305b58556adf59929a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(748c6c63-c038-44a9-8f52-e137578b30e7),volume_type_id=748c6c63-c038-44a9-8f52-e137578b30e7)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d61668-58e4-48b1-a799-ea3a16f1753c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2d61668-58e4-48b1-a799-ea3a16f1753c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc5cb44-aec0-4552-bc23-72e8c0701fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdc5cb44-aec0-4552-bc23-72e8c0701fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8c9c066-a43b-495f-9132-bb7ff1feff32', 'volume_name': 'volume-f8c9c066-a43b-495f-9132-bb7ff1feff32', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88dbf6d-9b7b-4cba-87ca-a0ef41714f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88dbf6d-9b7b-4cba-87ca-a0ef41714f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b261d9-51d0-4b3e-b8bb-ac40f521ee9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:28 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Volume f8c9c066-a43b-495f-9132-bb7ff1feff32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8c9c066-a43b-495f-9132-bb7ff1feff32', 'volume_size': 1} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1052046748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c9c066-a43b-495f-9132-bb7ff1feff32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da87369ce4bc4233a1c43fbb8103c3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:29Z,use_quota=True,user_id='ec2470f020fe4305b58556adf59929a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(748c6c63-c038-44a9-8f52-e137578b30e7),volume_type_id=748c6c63-c038-44a9-8f52-e137578b30e7)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Creating volume f8c9c066-a43b-495f-9132-bb7ff1feff32 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:28 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:28 devstack sudo[85642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 1073741824 Apr 10 12:15:28 devstack sudo[85642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:29 devstack sudo[85642]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 1073741824" returned: 0 in 0.748s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:29 devstack sudo[85673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 Apr 10 12:15:29 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:30 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32" returned: 0 in 0.553s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] <== create_volume: return (1348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.351s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89b261d9-51d0-4b3e-b8bb-ac40f521ee9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8c9c066-a43b-495f-9132-bb7ff1feff32', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b172440-3cfa-447b-ae33-b8a323fbe430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:30 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Volume volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 (f8c9c066-a43b-495f-9132-bb7ff1feff32): created successfully Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b172440-3cfa-447b-ae33-b8a323fbe430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Flow 'volume_create_manager' (eb41452b-1805-49f2-a746-dfb6e0b07849) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:30 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-025fa8d3-411e-46f3-bd61-b92c633cd600 tempest-VolumeTypesAccessTest-276070542 None] Created volume successfully. Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Acquiring lock "cinder-f8c9c066-a43b-495f-9132-bb7ff1feff32-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Lock "cinder-f8c9c066-a43b-495f-9132-bb7ff1feff32-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Acquiring lock "cinder-quobyte-f8c9c066-a43b-495f-9132-bb7ff1feff32" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Lock "cinder-quobyte-f8c9c066-a43b-495f-9132-bb7ff1feff32" acquired by "delete_volume" :: waited 0.023s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:31 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4334b633-941a-4b14-975c-c86441c38a01]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:31 devstack sudo[85679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 Apr 10 12:15:31 devstack sudo[85679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:31 devstack sudo[85679]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32" returned: 0 in 0.631s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:31 devstack sudo[85685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32 Apr 10 12:15:31 devstack sudo[85685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:32 devstack sudo[85685]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f8c9c066-a43b-495f-9132-bb7ff1feff32" returned: 0 in 0.836s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Lock "cinder-quobyte-f8c9c066-a43b-495f-9132-bb7ff1feff32" released by "delete_volume" :: held 1.503s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:32 devstack cinder-volume[82546]: WARNING cinder.quota [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2005192072 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2005192072, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:15:32 devstack cinder-volume[82546]: WARNING cinder.quota [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2005192072 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2005192072, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Created reservations ['92caadd3-ca82-4931-95c4-81a36a19c83e', '97df236b-19a1-4ff2-a35b-93f62e938ce7', '3c88bc28-e2b1-4bb0-9485-d94c23e11944', 'd6db6f5d-822e-407e-9e02-a4b8adc2f7eb'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:32 devstack sudo[85688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:32 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Flow 'volume_create_manager' (ac032575-586c-4878-8bce-0d6b3b37a2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4594d4f4-11d0-47b3-8c2f-2890a3e282b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4594d4f4-11d0-47b3-8c2f-2890a3e282b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:33Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45286cfd-5c73-45d4-9aa9-8df7d61b746a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd81fcd108b148789795b4aeee092d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:33Z,use_quota=True,user_id='9282d89361de4058b7eebf4c40f24117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a9228d-da4e-4428-9683-c66c43a79cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a9228d-da4e-4428-9683-c66c43a79cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899fe328-174d-40b0-8f1c-ba65f3409ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.image.glance [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Creating Keystone auth plugin from conf {{(pid=82546) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Flow 'volume_create_manager' (cf7625bc-a5d7-4d7d-9ee8-ea6a976202d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17441d8-fdb4-4d9f-af74-9059a079aab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c17441d8-fdb4-4d9f-af74-9059a079aab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1383633422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77af984a-ebb5-4ce4-b002-18662e756655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8394b91ced4414b30f406fd769d9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:34Z,use_quota=True,user_id='9b22c1f912c3415b894053f2969036e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eac37a4-e421-4684-a3cd-0f0f1fb16963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eac37a4-e421-4684-a3cd-0f0f1fb16963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0254d820-a301-4e51-b21c-46daee4bdc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0254d820-a301-4e51-b21c-46daee4bdc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77af984a-ebb5-4ce4-b002-18662e756655', 'volume_name': 'volume-77af984a-ebb5-4ce4-b002-18662e756655', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02183ebd-6f32-4735-b659-5f5ad54fb0ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02183ebd-6f32-4735-b659-5f5ad54fb0ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6022236-e519-4dd5-be11-4a3c4162027a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:33 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Volume 77af984a-ebb5-4ce4-b002-18662e756655: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77af984a-ebb5-4ce4-b002-18662e756655', 'volume_size': 1} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1383633422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77af984a-ebb5-4ce4-b002-18662e756655,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8394b91ced4414b30f406fd769d9ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:34Z,use_quota=True,user_id='9b22c1f912c3415b894053f2969036e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Creating volume 77af984a-ebb5-4ce4-b002-18662e756655 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:33 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:33 devstack sudo[85695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 1073741824 Apr 10 12:15:33 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:33 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.060s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:33 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Deleted volume successfully. Apr 10 12:15:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fd3bb570-a840-4913-a631-9fd602e90d5f tempest-VolumeTypesAccessTest-276070542 None] Lock "cinder-f8c9c066-a43b-495f-9132-bb7ff1feff32-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899fe328-174d-40b0-8f1c-ba65f3409ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45286cfd-5c73-45d4-9aa9-8df7d61b746a', 'volume_name': 'volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f8882-72a6-4b18-89de-39bef5cb5c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e5f8882-72a6-4b18-89de-39bef5cb5c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0ac870-5fcc-4fa0-8a66-1bf38f7b6eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:34 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Volume 45286cfd-5c73-45d4-9aa9-8df7d61b746a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Trying to clone 45286cfd-5c73-45d4-9aa9-8df7d61b746a from image 35717e41-b49c-4e85-9a50-2d2207b8655c at location (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]). {{(pid=82546) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 12:15:34 devstack cinder-volume[82546]: INFO cinder.image.image_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Image download 20.69 MB at 20.69 MB/s Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ec486d-e5d0-413c-91f7-b48fd2fde9ee]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:34 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 1073741824" returned: 0 in 0.934s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:34 devstack sudo[85722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD Apr 10 12:15:34 devstack sudo[85722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:34 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 Apr 10 12:15:34 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:35 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655" returned: 0 in 0.688s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6022236-e519-4dd5-be11-4a3c4162027a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77af984a-ebb5-4ce4-b002-18662e756655', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19c6df2-1d33-40eb-9236-08ddc0ef5965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:35 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Volume volume-77af984a-ebb5-4ce4-b002-18662e756655 (77af984a-ebb5-4ce4-b002-18662e756655): created successfully Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19c6df2-1d33-40eb-9236-08ddc0ef5965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Flow 'volume_create_manager' (cf7625bc-a5d7-4d7d-9ee8-ea6a976202d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:35 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c0d6bf77-22d9-42a3-83aa-90ea52267987 tempest-AbsoluteLimitsTests-1224741966 None] Created volume successfully. Apr 10 12:15:35 devstack sudo[85722]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD" returned: 0 in 0.897s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Temporary image 35717e41-b49c-4e85-9a50-2d2207b8655c is fetched for user 9282d89361de4058b7eebf4c40f24117. {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc1286f-39d7-422a-8dfa-ae6b97702821]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:35 devstack sudo[85730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD Apr 10 12:15:35 devstack sudo[85730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Acquiring lock "cinder-77af984a-ebb5-4ce4-b002-18662e756655-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Lock "cinder-77af984a-ebb5-4ce4-b002-18662e756655-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Acquiring lock "cinder-quobyte-77af984a-ebb5-4ce4-b002-18662e756655" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Lock "cinder-quobyte-77af984a-ebb5-4ce4-b002-18662e756655" acquired by "delete_volume" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[345fa17e-76f0-4b02-927c-1f6869661cc9]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:36 devstack sudo[85734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 Apr 10 12:15:36 devstack sudo[85734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:36 devstack sudo[85730]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD" returned: 0 in 0.840s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:33Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45286cfd-5c73-45d4-9aa9-8df7d61b746a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd81fcd108b148789795b4aeee092d27',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:33Z,use_quota=True,user_id='9282d89361de4058b7eebf4c40f24117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Creating volume 45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:36 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:36 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a 1073741824 Apr 10 12:15:36 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:36 devstack sudo[85734]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655" returned: 0 in 0.957s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:36 devstack sudo[85746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655 Apr 10 12:15:36 devstack sudo[85746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:37 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a 1073741824" returned: 0 in 0.897s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:37 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:15:37 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:37 devstack sudo[85746]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-77af984a-ebb5-4ce4-b002-18662e756655" returned: 0 in 1.019s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Lock "cinder-quobyte-77af984a-ebb5-4ce4-b002-18662e756655" released by "delete_volume" :: held 2.047s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Created reservations ['b8a06097-1409-429e-961b-6a34a6f509bd', '59038d06-13ff-485f-b227-029fa32303bd', '642d8361-b853-4554-a44a-6c849a9a28c9', '2949a02f-6d81-4d5c-bbf0-045d0da1520a'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:38 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 0 in 0.796s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.734s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:38 devstack sudo[85754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:38 devstack sudo[85754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Attempting download of 35717e41-b49c-4e85-9a50-2d2207b8655c ((None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}])) to volume 45286cfd-5c73-45d4-9aa9-8df7d61b746a. {{(pid=82546) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c61da38-bb20-4997-9d0d-e99c21088d48]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_h8zk5k6j {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:38 devstack sudo[85756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_h8zk5k6j Apr 10 12:15:38 devstack sudo[85756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:38 devstack sudo[85754]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.841s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:38 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Deleted volume successfully. Apr 10 12:15:38 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-468da4e8-2a84-4d99-8a41-ba8b5d4de28c tempest-AbsoluteLimitsTests-1224741966 None] Lock "cinder-77af984a-ebb5-4ce4-b002-18662e756655-delete_volume" released by "delete_volume" :: held 3.096s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:39 devstack sudo[85756]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_h8zk5k6j" returned: 0 in 1.072s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_h8zk5k6j {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:39 devstack sudo[85766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_h8zk5k6j Apr 10 12:15:39 devstack sudo[85766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:40 devstack sudo[85766]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_h8zk5k6j" returned: 1 in 0.918s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_h8zk5k6j' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:15:40 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04e7a6a-ac5f-44bd-a46c-1c68447cee44]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:40 devstack sudo[85770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD Apr 10 12:15:40 devstack sudo[85770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:40 devstack sudo[85770]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:40 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] 35717e41-b49c-4e85-9a50-2d2207b8655c was qcow2, converting to raw {{(pid=82546) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 12:15:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:40 devstack sudo[85786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:15:40 devstack sudo[85786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Flow 'volume_create_manager' (eecddb1f-172b-4f78-b893-a321c1cefa3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc70ab6-6387-4164-9ddb-97d54b26e196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bc70ab6-6387-4164-9ddb-97d54b26e196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1462777270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be07578c-f715-4796-b210-e85e60f13aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9a5fe47b6d425f9e73f7f37b2a247f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:41Z,use_quota=True,user_id='a6e1fec61cbc454c9b18e2bdfa3bd52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45041f34-8b7e-4639-a048-c002bea1d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45041f34-8b7e-4639-a048-c002bea1d593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef8d1d4-3ae1-4335-9e56-0d4fc27e1b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef8d1d4-3ae1-4335-9e56-0d4fc27e1b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be07578c-f715-4796-b210-e85e60f13aa3', 'volume_name': 'volume-be07578c-f715-4796-b210-e85e60f13aa3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fab55d-f9ec-4f8c-a009-6bd77f924fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0fab55d-f9ec-4f8c-a009-6bd77f924fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996bace9-8883-4105-9275-d7891adec13d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Volume be07578c-f715-4796-b210-e85e60f13aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be07578c-f715-4796-b210-e85e60f13aa3', 'volume_size': 1} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1462777270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be07578c-f715-4796-b210-e85e60f13aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9a5fe47b6d425f9e73f7f37b2a247f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:41Z,use_quota=True,user_id='a6e1fec61cbc454c9b18e2bdfa3bd52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Creating volume be07578c-f715-4796-b210-e85e60f13aa3 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:41 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:41 devstack sudo[85788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 1073741824 Apr 10 12:15:41 devstack sudo[85788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:42 devstack sudo[85788]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 1073741824" returned: 0 in 1.015s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:42 devstack sudo[85812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 Apr 10 12:15:42 devstack sudo[85812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:42 devstack sudo[85786]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 0 in 1.326s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_58pqvae0devstack@QuobyteHD, size 112.00 MB, duration 1.33 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:15:42 devstack cinder-volume[82546]: INFO cinder.image.image_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Converted 112.00 MB image at 84.36 MB/s Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:42 devstack sudo[85814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a 1G Apr 10 12:15:42 devstack sudo[85814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Flow 'volume_create_manager' (dd31e2f6-dc73-4162-bd14-3f91e1f4a4b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6d47bb-f3bf-48d8-afd0-a36135aa415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc6d47bb-f3bf-48d8-afd0-a36135aa415f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-122162930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58aa494-80ce-42bf-952c-1289b3babf15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ad55d03e8664303ad32d71be6991bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:42Z,use_quota=True,user_id='2d202a453ba94eb5a91b53bbe37aadea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af7f77d-3306-4a43-a56c-9b3ce4cfbd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af7f77d-3306-4a43-a56c-9b3ce4cfbd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c5fefc-9aba-4e9b-ae45-aa18304d766a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c5fefc-9aba-4e9b-ae45-aa18304d766a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e58aa494-80ce-42bf-952c-1289b3babf15', 'volume_name': 'volume-e58aa494-80ce-42bf-952c-1289b3babf15', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df3d4c7-b781-48bb-ba5e-d71db00bc09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0df3d4c7-b781-48bb-ba5e-d71db00bc09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeee785-682f-4680-948b-b42a3584df0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:42 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Volume e58aa494-80ce-42bf-952c-1289b3babf15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e58aa494-80ce-42bf-952c-1289b3babf15', 'volume_size': 1} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:42 devstack sudo[85812]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3" returned: 0 in 0.544s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] <== create_volume: return (1602ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.171s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-122162930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e58aa494-80ce-42bf-952c-1289b3babf15,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8ad55d03e8664303ad32d71be6991bda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:42Z,use_quota=True,user_id='2d202a453ba94eb5a91b53bbe37aadea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Creating volume e58aa494-80ce-42bf-952c-1289b3babf15 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:42 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:42 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 1073741824 Apr 10 12:15:42 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996bace9-8883-4105-9275-d7891adec13d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be07578c-f715-4796-b210-e85e60f13aa3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1325bf-1378-465b-b8be-a89d69885c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:42 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Volume volume-be07578c-f715-4796-b210-e85e60f13aa3 (be07578c-f715-4796-b210-e85e60f13aa3): created successfully Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb1325bf-1378-465b-b8be-a89d69885c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Flow 'volume_create_manager' (eecddb1f-172b-4f78-b893-a321c1cefa3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:42 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-245897bf-0b37-40ff-9ec6-56e662a21400 tempest-VolumesListAdminTestJSON-1514114970 None] Created volume successfully. Apr 10 12:15:42 devstack sudo[85814]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a 1G" returned: 0 in 0.704s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[95615f77-5729-4921-9e76-8a839c12fdbb]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:43 devstack sudo[85822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:15:43 devstack sudo[85822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:43 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 1073741824" returned: 0 in 0.852s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:43 devstack sudo[85835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 Apr 10 12:15:43 devstack sudo[85835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:43 devstack sudo[85822]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 0 in 0.811s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:43 devstack sudo[85837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:15:43 devstack sudo[85837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Flow 'volume_create_manager' (bab55e2d-5e3e-4292-a5e5-df486e519e11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9b30b0-f483-4fda-9a12-3771405d4471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd9b30b0-f483-4fda-9a12-3771405d4471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2032855590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9a5fe47b6d425f9e73f7f37b2a247f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:44Z,use_quota=True,user_id='a6e1fec61cbc454c9b18e2bdfa3bd52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57853ce-f41a-4c9c-abe6-2cf8852b3ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e57853ce-f41a-4c9c-abe6-2cf8852b3ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd05f8c-b648-4c48-842a-7ad8aa6a7a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bd05f8c-b648-4c48-842a-7ad8aa6a7a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46', 'volume_name': 'volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec91811c-79b3-497f-bf2b-024cb45f4fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec91811c-79b3-497f-bf2b-024cb45f4fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65153030-2d83-43d5-8d49-626b5fe68be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Volume c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46', 'volume_size': 1} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Flow 'volume_create_manager' (aea852c2-e3dc-481f-9ab6-542dc194ee8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7962d21c-0063-4e2e-9c99-45afa4baa774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7962d21c-0063-4e2e-9c99-45afa4baa774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1209677884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4307cfd5-635d-4614-9cdf-b81a363d5272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c84746e11f48f99a651e60fb75007e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:44Z,use_quota=True,user_id='2b2c530a1fa84522becbfb00bf395b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22536191-ccf5-4860-ae81-4986e3b908f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22536191-ccf5-4860-ae81-4986e3b908f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532876a0-4b5d-4c33-b48a-0bdb72502c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532876a0-4b5d-4c33-b48a-0bdb72502c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4307cfd5-635d-4614-9cdf-b81a363d5272', 'volume_name': 'volume-4307cfd5-635d-4614-9cdf-b81a363d5272', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd28db6-0551-4cfb-8c12-f0533d4e2b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fd28db6-0551-4cfb-8c12-f0533d4e2b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c046f7-9345-453c-bedb-f6b3dd712c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Volume 4307cfd5-635d-4614-9cdf-b81a363d5272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4307cfd5-635d-4614-9cdf-b81a363d5272', 'volume_size': 1} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:44 devstack sudo[85835]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15" returned: 0 in 0.633s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.316s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2032855590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9a5fe47b6d425f9e73f7f37b2a247f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:44Z,use_quota=True,user_id='a6e1fec61cbc454c9b18e2bdfa3bd52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Creating volume c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:44 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeee785-682f-4680-948b-b42a3584df0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e58aa494-80ce-42bf-952c-1289b3babf15', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack sudo[85842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 1073741824 Apr 10 12:15:44 devstack sudo[85842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858dcb17-1707-4b0f-8c82-fd12f6f3e6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Volume volume-e58aa494-80ce-42bf-952c-1289b3babf15 (e58aa494-80ce-42bf-952c-1289b3babf15): created successfully Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (858dcb17-1707-4b0f-8c82-fd12f6f3e6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Flow 'volume_create_manager' (dd31e2f6-dc73-4162-bd14-3f91e1f4a4b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:44 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-c31c4c4f-9dc2-4d21-9cad-a341fed46048 req-e0c1e3b9-19b8-4a98-b835-69e1410ad83c tempest-VolumesGetTestJSON-2038012009 None] Created volume successfully. Apr 10 12:15:44 devstack sudo[85837]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 1 in 0.623s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Downloaded image 35717e41-b49c-4e85-9a50-2d2207b8655c ((None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}])) to volume 45286cfd-5c73-45d4-9aa9-8df7d61b746a successfully. {{(pid=82546) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Temporary image 35717e41-b49c-4e85-9a50-2d2207b8655c for user 9282d89361de4058b7eebf4c40f24117 is deleted. {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Marking volume 45286cfd-5c73-45d4-9aa9-8df7d61b746a as bootable. {{(pid=82546) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Copying metadata from image 35717e41-b49c-4e85-9a50-2d2207b8655c to 45286cfd-5c73-45d4-9aa9-8df7d61b746a. {{(pid=82546) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Creating volume glance metadata for volume 45286cfd-5c73-45d4-9aa9-8df7d61b746a backed by image 35717e41-b49c-4e85-9a50-2d2207b8655c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82546) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe0ac870-5fcc-4fa0-8a66-1bf38f7b6eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72840424-0ef6-44fc-9d97-a822952b2207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:44 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Volume volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a (45286cfd-5c73-45d4-9aa9-8df7d61b746a): created successfully Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72840424-0ef6-44fc-9d97-a822952b2207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Flow 'volume_create_manager' (ac032575-586c-4878-8bce-0d6b3b37a2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:44 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-cc435638-dea7-4da8-b30c-b35339ba350a tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Created volume successfully. Apr 10 12:15:44 devstack sudo[85842]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 1073741824" returned: 0 in 0.552s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:44 devstack sudo[85859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 Apr 10 12:15:44 devstack sudo[85859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Acquiring lock "cinder-e58aa494-80ce-42bf-952c-1289b3babf15-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Lock "cinder-e58aa494-80ce-42bf-952c-1289b3babf15-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Acquiring lock "cinder-quobyte-e58aa494-80ce-42bf-952c-1289b3babf15" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Lock "cinder-quobyte-e58aa494-80ce-42bf-952c-1289b3babf15" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0adc1e-7ab7-4bb0-b053-513ae281ec6d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:45 devstack sudo[85864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 Apr 10 12:15:45 devstack sudo[85864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:45 devstack sudo[85859]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46" returned: 0 in 0.594s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.175s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.308s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1209677884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4307cfd5-635d-4614-9cdf-b81a363d5272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c84746e11f48f99a651e60fb75007e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:44Z,use_quota=True,user_id='2b2c530a1fa84522becbfb00bf395b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Creating volume 4307cfd5-635d-4614-9cdf-b81a363d5272 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:45 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65153030-2d83-43d5-8d49-626b5fe68be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:45 devstack sudo[85867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 1073741824 Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e82e3c-06d0-41e2-b06b-40ef5c7cc3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:45 devstack sudo[85867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:45 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Volume volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 (c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46): created successfully Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8e82e3c-06d0-41e2-b06b-40ef5c7cc3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Flow 'volume_create_manager' (bab55e2d-5e3e-4292-a5e5-df486e519e11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:45 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1f84f6ec-cd6f-4b09-8e52-eb881db374ae tempest-VolumesListAdminTestJSON-1514114970 None] Created volume successfully. Apr 10 12:15:45 devstack sudo[85864]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15" returned: 0 in 0.514s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:45 devstack sudo[85872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15 Apr 10 12:15:45 devstack sudo[85872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:46 devstack sudo[85867]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 1073741824" returned: 0 in 0.648s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:46 devstack sudo[85885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 Apr 10 12:15:46 devstack sudo[85885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Flow 'volume_create_manager' (33fbbfbb-2609-4f0a-9cbd-57206d86ec90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce920f85-f41f-4138-bc5f-11807c26f2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce920f85-f41f-4138-bc5f-11807c26f2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1426161889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34e25e7-2eb6-48b8-88f2-edeaa43154d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9a5fe47b6d425f9e73f7f37b2a247f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:46Z,use_quota=True,user_id='a6e1fec61cbc454c9b18e2bdfa3bd52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b358446-4e4c-479e-9aa9-e35dd2f715f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:46 devstack sudo[85872]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b358446-4e4c-479e-9aa9-e35dd2f715f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee7daf2-d412-432f-98f2-4fc55d03baf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee7daf2-d412-432f-98f2-4fc55d03baf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e34e25e7-2eb6-48b8-88f2-edeaa43154d7', 'volume_name': 'volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7c0305-bb0c-4ad2-a20f-98694c0a8e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b7c0305-bb0c-4ad2-a20f-98694c0a8e03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb150ae-8087-4299-986a-7e8285ab9b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:46 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Volume e34e25e7-2eb6-48b8-88f2-edeaa43154d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7', 'volume_size': 1} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e58aa494-80ce-42bf-952c-1289b3babf15" returned: 0 in 0.774s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Lock "cinder-quobyte-e58aa494-80ce-42bf-952c-1289b3babf15" released by "delete_volume" :: held 1.312s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.quota [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Created reservations ['7d2bb4b9-9c6b-438e-aef9-ea85da4aa3a1', '68ce3eea-56d9-42ee-8d51-94e44c848a0b', 'c043cfcc-22f6-4635-b903-370d8d56bc18', 'cb3df707-c97d-456b-8fb9-a645527115c9'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:46 devstack sudo[85888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:46 devstack sudo[85888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:46 devstack sudo[85885]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272" returned: 0 in 0.684s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.550s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46c046f7-9345-453c-bedb-f6b3dd712c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4307cfd5-635d-4614-9cdf-b81a363d5272', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6a1ab2-568e-45b5-9250-a029d6dafaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:46 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Volume volume-4307cfd5-635d-4614-9cdf-b81a363d5272 (4307cfd5-635d-4614-9cdf-b81a363d5272): created successfully Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c6a1ab2-568e-45b5-9250-a029d6dafaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Flow 'volume_create_manager' (aea852c2-e3dc-481f-9ab6-542dc194ee8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e13187-a8cf-41ce-9129-c679bf15d327]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-bc55e343-3a6d-4b51-9c11-f2195b1ecf86 tempest-VolumesTransfersV355Test-2140604659 None] Created volume successfully. Apr 10 12:15:47 devstack sudo[85891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:15:47 devstack sudo[85891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:47 devstack sudo[85888]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.469s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:47 devstack cinder-volume[82546]: DEBUG cinder.manager [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Deleted volume successfully. Apr 10 12:15:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-75aefedc-3771-4327-8cfb-92b9ade8b19c req-179b1a6b-55fa-445c-b958-4e826ce109fe tempest-VolumesGetTestJSON-2038012009 None] Lock "cinder-e58aa494-80ce-42bf-952c-1289b3babf15-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:47 devstack sudo[85891]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 0 in 0.517s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:47 devstack sudo[85896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:15:47 devstack sudo[85896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:48 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2be9d8a0-b7f0-48be-a28e-d42b2375c5f4 tempest-VolumesTransfersV355Test-1549294967 None] Transfer volume completed successfully. Apr 10 12:15:48 devstack sudo[85896]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 1 in 0.646s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.201s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.552s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1426161889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e34e25e7-2eb6-48b8-88f2-edeaa43154d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc9a5fe47b6d425f9e73f7f37b2a247f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:46Z,use_quota=True,user_id='a6e1fec61cbc454c9b18e2bdfa3bd52e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Creating volume e34e25e7-2eb6-48b8-88f2-edeaa43154d7 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:48 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:48 devstack sudo[85901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 1073741824 Apr 10 12:15:48 devstack sudo[85901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196', 'name': 'volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85f4feed-08a2-4dfb-9495-102a7a938ffe', 'enforce_multipath': True} {{(pid=82546) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 10 12:15:48 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-930d0ae6-f3e7-493e-a8bb-1d002c60e291 req-ce0fc4b6-1ed8-46f5-a79b-5cb9dfb81fda tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] attachment_update completed successfully. Apr 10 12:15:48 devstack sudo[85901]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 1073741824" returned: 0 in 0.821s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:48 devstack sudo[85907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 Apr 10 12:15:48 devstack sudo[85907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Acquiring lock "cinder-4307cfd5-635d-4614-9cdf-b81a363d5272-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Lock "cinder-4307cfd5-635d-4614-9cdf-b81a363d5272-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Acquiring lock "cinder-quobyte-4307cfd5-635d-4614-9cdf-b81a363d5272" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Lock "cinder-quobyte-4307cfd5-635d-4614-9cdf-b81a363d5272" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8b4230-cdb4-4f67-9f5f-b550dc16e0d0]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:49 devstack sudo[85909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 Apr 10 12:15:49 devstack sudo[85909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:49 devstack sudo[85907]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7" returned: 0 in 0.533s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cb150ae-8087-4299-986a-7e8285ab9b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78604320-6cf9-4f9a-acec-6b3b9f4e3841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:49 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Volume volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 (e34e25e7-2eb6-48b8-88f2-edeaa43154d7): created successfully Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78604320-6cf9-4f9a-acec-6b3b9f4e3841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Flow 'volume_create_manager' (33fbbfbb-2609-4f0a-9cbd-57206d86ec90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:49 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f4cf1483-49c8-4539-9b7e-d11be08e5a23 tempest-VolumesListAdminTestJSON-1514114970 None] Created volume successfully. Apr 10 12:15:50 devstack sudo[85909]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272" returned: 0 in 0.954s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:50 devstack sudo[85949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272 Apr 10 12:15:50 devstack sudo[85949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Flow 'volume_create_manager' (d7d49592-d13f-4497-9d92-f2f2419f7ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cc0638-9260-4ab3-a9f2-e179a3595c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41cc0638-9260-4ab3-a9f2-e179a3595c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bbb914-2702-468a-9feb-f9ace457dcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6e52b306f743e7be06717f9eb17933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:50Z,use_quota=True,user_id='ae51a78a3c9b490693250346a18da841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c330ca46-3d68-4fb4-804a-98e59ad943fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c330ca46-3d68-4fb4-804a-98e59ad943fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465f432f-c52b-4159-be51-8605f4038758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (465f432f-c52b-4159-be51-8605f4038758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94bbb914-2702-468a-9feb-f9ace457dcc5', 'volume_name': 'volume-94bbb914-2702-468a-9feb-f9ace457dcc5', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ab14f6-5142-4937-bd14-520697459484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90ab14f6-5142-4937-bd14-520697459484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5137f79-f369-49af-8257-801d05634e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:50 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Volume 94bbb914-2702-468a-9feb-f9ace457dcc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94bbb914-2702-468a-9feb-f9ace457dcc5', 'volume_size': 1} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:50Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94bbb914-2702-468a-9feb-f9ace457dcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe6e52b306f743e7be06717f9eb17933',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:50Z,use_quota=True,user_id='ae51a78a3c9b490693250346a18da841',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Creating volume 94bbb914-2702-468a-9feb-f9ace457dcc5 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:50 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:50 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 1073741824 Apr 10 12:15:50 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6b0d561a-9658-4b66-95ce-b440d278ce78 tempest-GroupSnapshotsTest-365159363 None] Group tempest-GroupSnapshotsTest-Group-1104979868: creating Apr 10 12:15:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6b0d561a-9658-4b66-95ce-b440d278ce78 tempest-GroupSnapshotsTest-365159363 None] Group tempest-GroupSnapshotsTest-Group-1104979868: created successfully Apr 10 12:15:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6b0d561a-9658-4b66-95ce-b440d278ce78 tempest-GroupSnapshotsTest-365159363 None] Create group completed successfully. Apr 10 12:15:50 devstack sudo[85949]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4307cfd5-635d-4614-9cdf-b81a363d5272" returned: 0 in 0.554s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Lock "cinder-quobyte-4307cfd5-635d-4614-9cdf-b81a363d5272" released by "delete_volume" :: held 1.529s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Created reservations ['2782ff7d-ae4a-466b-963c-3feb268e1642', '2a887af4-a1eb-4baa-8c68-88549c6a516f', 'ce28294e-6449-4d2b-b7cb-e71afdfda7ec', 'd2d1c857-25f0-4bab-b6c9-1666a3deb45f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:50 devstack sudo[85954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:50 devstack sudo[85954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:51 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 1073741824" returned: 0 in 0.570s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:51 devstack sudo[85962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 Apr 10 12:15:51 devstack sudo[85962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:51 devstack sudo[85954]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.466s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:51 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Deleted volume successfully. Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ae3b4156-7c5d-49e6-9604-9cbf37b8fdfc tempest-VolumesTransfersV355Test-616251008 None] Lock "cinder-4307cfd5-635d-4614-9cdf-b81a363d5272-delete_volume" released by "delete_volume" :: held 2.149s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:51 devstack sudo[85962]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5" returned: 0 in 0.442s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5137f79-f369-49af-8257-801d05634e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94bbb914-2702-468a-9feb-f9ace457dcc5', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f210139d-5423-4575-b50a-56ca315a513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Volume volume-94bbb914-2702-468a-9feb-f9ace457dcc5 (94bbb914-2702-468a-9feb-f9ace457dcc5): created successfully Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f210139d-5423-4575-b50a-56ca315a513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Flow 'volume_create_manager' (d7d49592-d13f-4497-9d92-f2f2419f7ac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:51 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3a0bb4f4-a115-4270-be82-4d0cb7bb0987 tempest-VolumesListAdminTestJSON-268703540 None] Created volume successfully. Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Flow 'volume_create_manager' (c55b46cc-9490-47ce-83c2-04218c831815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8976811-2743-4bb3-a168-f0574742c2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8976811-2743-4bb3-a168-f0574742c2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-478369258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6ad0a8-9d99-47e4-84ef-c4296cd21183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c84746e11f48f99a651e60fb75007e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:52Z,use_quota=True,user_id='2b2c530a1fa84522becbfb00bf395b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881f34ed-77c0-4e0e-97de-72be27f86547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (881f34ed-77c0-4e0e-97de-72be27f86547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ef6608-6999-4154-8c20-d77d1b652324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ef6608-6999-4154-8c20-d77d1b652324) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f6ad0a8-9d99-47e4-84ef-c4296cd21183', 'volume_name': 'volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88af90fe-f523-4a4a-b19d-9fa816cf9d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88af90fe-f523-4a4a-b19d-9fa816cf9d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1536043a-b58f-4eea-a957-0c19f702f3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Volume 4f6ad0a8-9d99-47e4-84ef-c4296cd21183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183', 'volume_size': 1} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-478369258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f6ad0a8-9d99-47e4-84ef-c4296cd21183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84c84746e11f48f99a651e60fb75007e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:52Z,use_quota=True,user_id='2b2c530a1fa84522becbfb00bf395b79',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Creating volume 4f6ad0a8-9d99-47e4-84ef-c4296cd21183 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:51 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:51 devstack sudo[85966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 1073741824 Apr 10 12:15:51 devstack sudo[85966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Flow 'volume_create_manager' (fb7861e1-3b62-40ea-8dd8-eb694acc4eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcb083d-606f-4cc9-bac5-aa1d72b9bd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fcb083d-606f-4cc9-bac5-aa1d72b9bd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-21637016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58683117-2a98-43cf-8a64-9901a781ee73,host='devstack@QuobyteHD#QuobyteHD',id=4506b2a1-0457-4679-953a-fa1625893450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853307c8a4744284a853616d0a1fe9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:52Z,use_quota=True,user_id='4070d4c57a25435aa94f1112e8798dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfe8117-f6bd-41ad-91c0-a97101a8aa6b),volume_type_id=bbfe8117-f6bd-41ad-91c0-a97101a8aa6b)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab90c0c6-aa99-49e6-996b-f05c95be5976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab90c0c6-aa99-49e6-996b-f05c95be5976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5763d0-1fbb-43b9-a461-707f975c79d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a5763d0-1fbb-43b9-a461-707f975c79d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4506b2a1-0457-4679-953a-fa1625893450', 'volume_name': 'volume-4506b2a1-0457-4679-953a-fa1625893450', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3279bd98-6c08-452f-8567-17a4426c2126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3279bd98-6c08-452f-8567-17a4426c2126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d98c9c0-5328-4414-b7d5-07611abad94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:51 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Volume 4506b2a1-0457-4679-953a-fa1625893450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4506b2a1-0457-4679-953a-fa1625893450', 'volume_size': 1} Apr 10 12:15:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:52 devstack sudo[85966]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 1073741824" returned: 0 in 0.525s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:52 devstack sudo[85971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 Apr 10 12:15:52 devstack sudo[85971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Acquiring lock "cinder-94bbb914-2702-468a-9feb-f9ace457dcc5-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:52 devstack sudo[85971]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183" returned: 0 in 0.542s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Lock "cinder-94bbb914-2702-468a-9feb-f9ace457dcc5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=58683117-2a98-43cf-8a64-9901a781ee73,created_at=2026-04-10T10:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-21637016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=58683117-2a98-43cf-8a64-9901a781ee73,host='devstack@QuobyteHD#QuobyteHD',id=4506b2a1-0457-4679-953a-fa1625893450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853307c8a4744284a853616d0a1fe9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:15:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:15:52Z,use_quota=True,user_id='4070d4c57a25435aa94f1112e8798dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bbfe8117-f6bd-41ad-91c0-a97101a8aa6b),volume_type_id=bbfe8117-f6bd-41ad-91c0-a97101a8aa6b)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Creating volume 4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:15:52 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:52 devstack sudo[85998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 1073741824 Apr 10 12:15:52 devstack sudo[85998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1536043a-b58f-4eea-a957-0c19f702f3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1237d016-31eb-427e-ad4c-092fcf0c43e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:52 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Volume volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 (4f6ad0a8-9d99-47e4-84ef-c4296cd21183): created successfully Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1237d016-31eb-427e-ad4c-092fcf0c43e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Flow 'volume_create_manager' (c55b46cc-9490-47ce-83c2-04218c831815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Acquiring lock "cinder-quobyte-94bbb914-2702-468a-9feb-f9ace457dcc5" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:52 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-4af054db-6ee0-4d08-bc00-3f84c70eabab tempest-VolumesTransfersV355Test-2140604659 None] Created volume successfully. Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Lock "cinder-quobyte-94bbb914-2702-468a-9feb-f9ace457dcc5" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b30dd9e-d44a-4036-9cca-02d38cf5f43a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "cinder-e34e25e7-2eb6-48b8-88f2-edeaa43154d7-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-e34e25e7-2eb6-48b8-88f2-edeaa43154d7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:53 devstack sudo[86001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "cinder-quobyte-e34e25e7-2eb6-48b8-88f2-edeaa43154d7" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:53 devstack sudo[86001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-quobyte-e34e25e7-2eb6-48b8-88f2-edeaa43154d7" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ec8831-0535-4474-adc7-3c7be4eb6881]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:53 devstack sudo[86003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 Apr 10 12:15:53 devstack sudo[86003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:53 devstack sudo[85998]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 1073741824" returned: 0 in 0.896s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:53 devstack sudo[86001]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5" returned: 0 in 0.786s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:53 devstack sudo[86017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5 Apr 10 12:15:53 devstack sudo[86017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:53 devstack sudo[86019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 Apr 10 12:15:53 devstack sudo[86019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:53 devstack sudo[86003]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7" returned: 0 in 0.743s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:53 devstack sudo[86021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7 Apr 10 12:15:53 devstack sudo[86021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Acquiring lock "cinder-4f6ad0a8-9d99-47e4-84ef-c4296cd21183-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Lock "cinder-4f6ad0a8-9d99-47e4-84ef-c4296cd21183-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Acquiring lock "cinder-quobyte-4f6ad0a8-9d99-47e4-84ef-c4296cd21183" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Lock "cinder-quobyte-4f6ad0a8-9d99-47e4-84ef-c4296cd21183" acquired by "delete_volume" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[360ad301-6f95-45f8-9aab-6fba2ef1b3b7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:54 devstack sudo[86021]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e34e25e7-2eb6-48b8-88f2-edeaa43154d7" returned: 0 in 0.613s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-quobyte-e34e25e7-2eb6-48b8-88f2-edeaa43154d7" released by "delete_volume" :: held 1.386s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Created reservations ['7a7c1d95-f02b-4dde-ac8b-bdd7d76d91bb', 'd37b7a82-897e-4f14-8902-cb28a948a7e0', 'b7ee6afb-7a6b-4d03-8299-49fd381714ac', '700f988d-5007-4ac0-a23c-24bb58876127'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:54 devstack sudo[86017]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-94bbb914-2702-468a-9feb-f9ace457dcc5" returned: 0 in 0.787s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:54 devstack sudo[86025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 Apr 10 12:15:54 devstack sudo[86025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Lock "cinder-quobyte-94bbb914-2702-468a-9feb-f9ace457dcc5" released by "delete_volume" :: held 1.624s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Created reservations ['28455220-7314-462e-8188-3329e31fe6ab', 'b018883d-2b5a-4f85-bdde-b98196cbd04b', '5e321c03-9dcc-4109-b1ef-bda369c56fc0', '29b615ac-7af9-42a6-8550-d39f4f3f1efc'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:54 devstack sudo[86019]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450" returned: 0 in 0.882s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] <== create_volume: return (1844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:54 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:54 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d98c9c0-5328-4414-b7d5-07611abad94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4506b2a1-0457-4679-953a-fa1625893450', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d5609c-5a30-4903-af72-a04a26d889b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:15:54 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Volume volume-4506b2a1-0457-4679-953a-fa1625893450 (4506b2a1-0457-4679-953a-fa1625893450): created successfully Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47d5609c-5a30-4903-af72-a04a26d889b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:15:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Flow 'volume_create_manager' (fb7861e1-3b62-40ea-8dd8-eb694acc4eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:15:54 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-df4f4eb3-011b-436e-a297-4ad5d831a6dd tempest-GroupSnapshotsTest-365159363 None] Created volume successfully. Apr 10 12:15:54 devstack sudo[86030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:54 devstack sudo[86030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "cinder-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:55 devstack sudo[86025]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183" returned: 0 in 1.008s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "cinder-quobyte-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:55 devstack sudo[86039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183 Apr 10 12:15:55 devstack sudo[86039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-quobyte-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46" acquired by "delete_volume" :: waited 0.020s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2451f835-3ea7-4639-8c71-50e5258aa02b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:55 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.898s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Deleted volume successfully. Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c404d4e9-692d-49fb-9872-e51093016288 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-e34e25e7-2eb6-48b8-88f2-edeaa43154d7-delete_volume" released by "delete_volume" :: held 2.605s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:55 devstack sudo[86030]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.908s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Deleted volume successfully. Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8f9e4fda-feda-4b19-acbb-2c00615dc831 tempest-VolumesListAdminTestJSON-268703540 None] Lock "cinder-94bbb914-2702-468a-9feb-f9ace457dcc5-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:55 devstack sudo[86041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 Apr 10 12:15:55 devstack sudo[86041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] GroupSnapshot 9aef506e-bf80-4eae-87e9-a0f4230900f1: creating. Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Group snapshot 9aef506e-bf80-4eae-87e9-a0f4230900f1: creating. {{(pid=82546) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Creating offline snapshot 1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 of volume 4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd99786-88d7-4b0c-bee1-0d4796fd89a7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:56 devstack sudo[86043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 Apr 10 12:15:56 devstack sudo[86043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:56 devstack sudo[86039]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4f6ad0a8-9d99-47e4-84ef-c4296cd21183" returned: 0 in 0.797s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Lock "cinder-quobyte-4f6ad0a8-9d99-47e4-84ef-c4296cd21183" released by "delete_volume" :: held 1.834s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Created reservations ['3052e30d-a33b-460c-b594-ffa33f1f43a6', '874b72d0-06cc-4a26-95e9-6fead399826a', '0da29f55-d8dc-4b15-8bb9-b4d71279b141', '2058b555-d7b5-4fe7-9b8f-944ef0b26879'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:56 devstack sudo[86050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:56 devstack sudo[86050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:56 devstack sudo[86041]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46" returned: 0 in 0.846s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:56 devstack sudo[86052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46 Apr 10 12:15:56 devstack sudo[86052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:56 devstack sudo[86043]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450" returned: 0 in 0.749s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:56 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 1G Apr 10 12:15:56 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:56 devstack sudo[86050]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.651s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Deleted volume successfully. Apr 10 12:15:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77f8ad53-2a79-4da3-91b8-ba16ccd52c53 tempest-VolumesTransfersV355Test-616251008 None] Lock "cinder-4f6ad0a8-9d99-47e4-84ef-c4296cd21183-delete_volume" released by "delete_volume" :: held 2.685s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:57 devstack sudo[86052]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46" returned: 0 in 0.632s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-quobyte-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46" released by "delete_volume" :: held 1.522s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Created reservations ['c3370193-4a9d-46d8-ae9c-b87e56f161d2', 'a7dafefc-a2f0-40dd-bc63-873b6ce50225', '40fb6002-0537-445f-b6bf-6d110f6435bd', 'd2ba906c-d265-4020-be33-1451f67df0c9'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:57 devstack sudo[86064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:15:57 devstack sudo[86064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:57 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 1G" returned: 0 in 0.740s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4506b2a1-0457-4679-953a-fa1625893450 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:57 devstack sudo[86066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4506b2a1-0457-4679-953a-fa1625893450 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 Apr 10 12:15:57 devstack sudo[86066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "cinder-be07578c-f715-4796-b210-e85e60f13aa3-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-be07578c-f715-4796-b210-e85e60f13aa3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "cinder-quobyte-be07578c-f715-4796-b210-e85e60f13aa3" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-quobyte-be07578c-f715-4796-b210-e85e60f13aa3" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acac666-4d3c-46f8-9ac2-0dfb53882a78]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:57 devstack sudo[86064]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.706s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:15:57 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Deleted volume successfully. Apr 10 12:15:57 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 Apr 10 12:15:57 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-92d10877-6cc9-4f28-80a3-6f37505d8bfb tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-c0f81d6b-2e69-4dfa-a0bb-91e47d3aeb46-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:15:58 devstack sudo[86066]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4506b2a1-0457-4679-953a-fa1625893450 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" returned: 0 in 0.818s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:58 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:15:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:58 devstack sudo[86074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 Apr 10 12:15:58 devstack sudo[86074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:58 devstack sudo[86074]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" returned: 0 in 0.612s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:58 devstack sudo[86080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.info Apr 10 12:15:58 devstack sudo[86080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:58 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3" returned: 0 in 1.221s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:59 devstack sudo[86082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3 Apr 10 12:15:59 devstack sudo[86082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:15:59 devstack sudo[86080]: pam_unix(sudo:session): session closed for user root Apr 10 12:15:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.info" returned: 0 in 0.778s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:15:59 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:15:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:15:59 devstack sudo[86085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.info Apr 10 12:15:59 devstack sudo[86085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:00 devstack sudo[86082]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-be07578c-f715-4796-b210-e85e60f13aa3" returned: 0 in 1.026s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-quobyte-be07578c-f715-4796-b210-e85e60f13aa3" released by "delete_volume" :: held 2.304s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Created reservations ['da0bb989-3493-44cf-89ef-f555013c10fb', 'aadeea7a-0e01-4312-ad66-fef09592279c', '58f260fc-72bf-4613-800f-53797555bae0', '2c0fbcc1-f8d6-4c50-a443-396b79a57d72'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:00 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:00 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:00 devstack sudo[86085]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.info" returned: 0 in 0.887s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.672s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7d709ee4-1b52-44c9-b51a-bbf78bbdb0cc tempest-GroupSnapshotsTest-365159363 None] group_snapshot 9aef506e-bf80-4eae-87e9-a0f4230900f1: created successfully Apr 10 12:16:00 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.518s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Deleted volume successfully. Apr 10 12:16:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c141f44-a40a-482c-b434-92bef610f867 tempest-VolumesListAdminTestJSON-1514114970 None] Lock "cinder-be07578c-f715-4796-b210-e85e60f13aa3-delete_volume" released by "delete_volume" :: held 3.014s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-1f2a7d79-6bd0-43e5-ac2e-83ab63b15558-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" by "_create_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-1f2a7d79-6bd0-43e5-ac2e-83ab63b15558-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Creating volume 11dd1f8a-f592-4cb7-b8b4-e4828e21b884 from snapshot 1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 {{(pid=82546) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] snapshot: 1f2a7d79-6bd0-43e5-ac2e-83ab63b15558, volume: 11dd1f8a-f592-4cb7-b8b4-e4828e21b884, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce7b9e9-31bb-49c6-965a-a0a72d696a1f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:02 devstack sudo[86134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 Apr 10 12:16:02 devstack sudo[86134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:02 devstack sudo[86134]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" returned: 0 in 0.653s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4506b2a1-0457-4679-953a-fa1625893450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[78901d50-6f64-424c-b821-55064cdc0b42]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:02 devstack sudo[86139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 Apr 10 12:16:02 devstack sudo[86139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:02 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Flow 'volume_create_manager' (4c197c46-48cd-473e-b5e7-1ddac7822d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d882c7-4071-4961-ab93-c176042faa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5d882c7-4071-4961-ab93-c176042faa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1091915577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff5ed2f-db31-4bf3-9964-c76b31a948c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5a92b244f34a5e8304baa2f72e30b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:03Z,use_quota=True,user_id='5fc8e4bc3c8c4ebebe2bb9dadeb42ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f23dc1-2697-46ad-8864-339e29a7276f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f23dc1-2697-46ad-8864-339e29a7276f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad66f32-b90c-440d-9f47-f93ff8982a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ad66f32-b90c-440d-9f47-f93ff8982a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff5ed2f-db31-4bf3-9964-c76b31a948c1', 'volume_name': 'volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5659335-e134-42b3-945d-7de58f1251f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5659335-e134-42b3-945d-7de58f1251f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3f8f51-405a-40cf-91a5-130db544be4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Volume dff5ed2f-db31-4bf3-9964-c76b31a948c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1', 'volume_size': 1} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:03 devstack sudo[86139]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450" returned: 0 in 0.605s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:03 devstack sudo[86144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 Apr 10 12:16:03 devstack sudo[86144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Flow 'volume_create_manager' (dea536ee-7ec7-4563-a389-c1aa40965309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702e5298-0c73-4b20-aa9e-11ade75cca87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (702e5298-0c73-4b20-aa9e-11ade75cca87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-365305238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac92bae6-bd1a-40af-9e67-fed822c4cd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb31af905ac14586be79d80b389dd609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:04Z,use_quota=True,user_id='0584211db5214514a3ee8b21cfc36f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292b31a9-aabd-4a67-893b-fa50ecb50cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292b31a9-aabd-4a67-893b-fa50ecb50cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d0a91-ded8-4212-8851-b3c1b51f33be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a35d0a91-ded8-4212-8851-b3c1b51f33be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac92bae6-bd1a-40af-9e67-fed822c4cd44', 'volume_name': 'volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c832991-d257-4e8d-85bb-8a29060a9fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c832991-d257-4e8d-85bb-8a29060a9fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a84e173-9fdd-4988-b161-8d65ac29600d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:03 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Volume ac92bae6-bd1a-40af-9e67-fed822c4cd44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44', 'volume_size': 1} Apr 10 12:16:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:06 devstack sudo[86144]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" returned: 0 in 2.577s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:06 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[526394a1-5a88-4468-9300-7f538275db43]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:06 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 Apr 10 12:16:06 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:06 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450" returned: 0 in 0.786s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:06 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:16:06 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Converted 1024.00 MB image at 397.21 MB/s Apr 10 12:16:06 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:16:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:06 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 Apr 10 12:16:06 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:07 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" returned: 0 in 0.484s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" released by "_copy_volume_from_snapshot" :: held 5.264s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-1f2a7d79-6bd0-43e5-ac2e-83ab63b15558-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" released by "_create_volume_from_snapshot" :: held 5.287s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.301s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.311s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1091915577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff5ed2f-db31-4bf3-9964-c76b31a948c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5a92b244f34a5e8304baa2f72e30b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:03Z,use_quota=True,user_id='5fc8e4bc3c8c4ebebe2bb9dadeb42ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Creating volume dff5ed2f-db31-4bf3-9964-c76b31a948c1 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:07 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:07 devstack sudo[86210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 1073741824 Apr 10 12:16:07 devstack sudo[86210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:07 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-273fb231-5d3f-4239-9ed7-825a867a963e tempest-GroupSnapshotsTest-365159363 None] Create group from source-snapshot-9aef506e-bf80-4eae-87e9-a0f4230900f1 completed successfully. Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:07 devstack sudo[86210]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 1073741824" returned: 0 in 0.580s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43004ee-da30-4415-844f-34c2bc6df793]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:08 devstack sudo[86216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 Apr 10 12:16:08 devstack sudo[86216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:08 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 Apr 10 12:16:08 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:08 devstack sudo[86216]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1" returned: 0 in 0.528s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] <== create_volume: return (1148ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.631s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-365305238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac92bae6-bd1a-40af-9e67-fed822c4cd44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb31af905ac14586be79d80b389dd609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:04Z,use_quota=True,user_id='0584211db5214514a3ee8b21cfc36f55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Creating volume ac92bae6-bd1a-40af-9e67-fed822c4cd44 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:08 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e3f8f51-405a-40cf-91a5-130db544be4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64894e54-46fb-427a-90f4-65845e5472de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:08 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Volume volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 (dff5ed2f-db31-4bf3-9964-c76b31a948c1): created successfully Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64894e54-46fb-427a-90f4-65845e5472de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:08 devstack sudo[86224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 1073741824 Apr 10 12:16:08 devstack sudo[86224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:08 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Flow 'volume_create_manager' (4c197c46-48cd-473e-b5e7-1ddac7822d5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" returned: 0 in 0.636s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:08 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-547f3109-02fd-4243-ad7e-16e619eaf0e9 tempest-VolumesTransfersV357Test-873941983 None] Created volume successfully. Apr 10 12:16:08 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884 Apr 10 12:16:08 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:09 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" returned: 0 in 0.440s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-11dd1f8a-f592-4cb7-b8b4-e4828e21b884" released by "delete_volume" :: held 1.113s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Created reservations ['a9c242dc-4a77-4d25-985f-40425478e9bd'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:09 devstack cinder-volume[82546]: WARNING cinder.quota [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1639200469 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1639200469, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:16:09 devstack cinder-volume[82546]: WARNING cinder.quota [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1639200469 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1639200469, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:16:09 devstack sudo[86224]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Created reservations ['78455f6a-43ed-4638-81ad-b7e27d3a8641', 'b574fbf1-9a0c-492c-a883-2b5bc90c37ef', '0cb8c0fc-ac4d-4453-be8c-9e31609c9b0e', '76235ea7-b431-4ed4-a2bc-369946fbc8b7'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 1073741824" returned: 0 in 0.578s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:09 devstack sudo[86232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 Apr 10 12:16:09 devstack sudo[86232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:09 devstack sudo[86234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:09 devstack sudo[86234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:09 devstack sudo[86232]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44" returned: 0 in 0.440s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] <== create_volume: return (1059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a84e173-9fdd-4988-b161-8d65ac29600d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef908b1a-4fa7-4a29-827d-92d6c4bd9cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:09 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Volume volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 (ac92bae6-bd1a-40af-9e67-fed822c4cd44): created successfully Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef908b1a-4fa7-4a29-827d-92d6c4bd9cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Flow 'volume_create_manager' (dea536ee-7ec7-4563-a389-c1aa40965309) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:09 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3fb382ea-7db4-44ff-9850-dadcfbef701f tempest-SnapshotMetadataTestJSON-587453314 None] Created volume successfully. Apr 10 12:16:09 devstack sudo[86234]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.521s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:09 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:09 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6af37764-672b-4534-a3e9-96717a374e25 tempest-GroupSnapshotsTest-365159363 None] Delete group completed successfully. Apr 10 12:16:10 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-8406bedd-3192-4e63-95a4-7fc662a13ca0 tempest-VolumesTransfersV357Test-763043435 None] Transfer volume completed successfully. Apr 10 12:16:10 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] group_snapshot 9aef506e-bf80-4eae-87e9-a0f4230900f1: deleting Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] group_snapshot 9aef506e-bf80-4eae-87e9-a0f4230900f1: deleting {{(pid=82546) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-4506b2a1-0457-4679-953a-fa1625893450" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-4506b2a1-0457-4679-953a-fa1625893450" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Deleting offline snapshot 1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 of volume 4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] snapshot_file for this snap is: volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f8a563-86f4-4830-83ee-d842776f464b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:10 devstack sudo[86266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 Apr 10 12:16:10 devstack sudo[86266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Creating offline snapshot a3f09ec7-3e76-4030-b067-e6411ec0d768 of volume ac92bae6-bd1a-40af-9e67-fed822c4cd44 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[185a5c53-c324-45a2-b0b9-1337a85fdf20]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:10 devstack sudo[86290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 Apr 10 12:16:10 devstack sudo[86290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Acquiring lock "cinder-dff5ed2f-db31-4bf3-9964-c76b31a948c1-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Lock "cinder-dff5ed2f-db31-4bf3-9964-c76b31a948c1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:11 devstack sudo[86266]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" returned: 0 in 0.957s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4506b2a1-0457-4679-953a-fa1625893450(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0fc698-1a46-4f43-af63-4b857c220b2e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Acquiring lock "cinder-quobyte-dff5ed2f-db31-4bf3-9964-c76b31a948c1" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Lock "cinder-quobyte-dff5ed2f-db31-4bf3-9964-c76b31a948c1" acquired by "delete_volume" :: waited 0.030s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c92acd-3788-4f2c-91dc-39ab61ebb239]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:11 devstack sudo[86297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 Apr 10 12:16:11 devstack sudo[86297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:11 devstack sudo[86299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 Apr 10 12:16:11 devstack sudo[86299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:11 devstack sudo[86290]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44" returned: 0 in 0.873s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:11 devstack sudo[86304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 1G Apr 10 12:16:11 devstack sudo[86304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:11 devstack sudo[86297]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450" returned: 0 in 0.610s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:11 devstack sudo[86299]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1" returned: 0 in 0.582s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:11 devstack sudo[86312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 Apr 10 12:16:11 devstack sudo[86312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:11 devstack sudo[86314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1 Apr 10 12:16:11 devstack sudo[86314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:12 devstack sudo[86304]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 1G" returned: 0 in 0.745s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:12 devstack sudo[86319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 Apr 10 12:16:12 devstack sudo[86319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:12 devstack sudo[86314]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dff5ed2f-db31-4bf3-9964-c76b31a948c1" returned: 0 in 0.542s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Lock "cinder-quobyte-dff5ed2f-db31-4bf3-9964-c76b31a948c1" released by "delete_volume" :: held 1.156s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Created reservations ['c9187d77-cc9f-4080-accf-7804f1250e6b', '90a00ceb-b047-4c28-a157-64aab59d72a9', '4e1bea03-6cc4-4f22-bbba-706e753fe919', '913cdb8e-ebae-4f21-80fe-dd983200e086'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:12 devstack sudo[86312]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" returned: 0 in 0.648s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:12 devstack sudo[86325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558 Apr 10 12:16:12 devstack sudo[86325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:12 devstack sudo[86327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:12 devstack sudo[86327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:12 devstack sudo[86319]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768" returned: 0 in 0.680s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:12 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 is being set with open permissions: ugo+rw Apr 10 12:16:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:12 devstack sudo[86333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 Apr 10 12:16:12 devstack sudo[86333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:13 devstack sudo[86325]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450.1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" returned: 0 in 0.768s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-1f2a7d79-6bd0-43e5-ac2e-83ab63b15558" released by "_delete_snapshot" :: held 3.084s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-4506b2a1-0457-4679-953a-fa1625893450" released by "delete_snapshot" :: held 3.096s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:13 devstack sudo[86327]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.765s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:13 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Deleted volume successfully. Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-946cf8d3-baf8-4b22-b4b8-420376b2f229 tempest-VolumesTransfersV357Test-812684738 None] Lock "cinder-dff5ed2f-db31-4bf3-9964-c76b31a948c1-delete_volume" released by "delete_volume" :: held 2.224s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:13 devstack sudo[86333]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768" returned: 0 in 0.510s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:13 devstack cinder-volume[82546]: WARNING cinder.quota [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1639200469 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1639200469, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:13 devstack sudo[86339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.info Apr 10 12:16:13 devstack sudo[86339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] Created reservations ['e28df999-3074-4ff2-a580-e8cb4838680c', 'dd562f9c-5699-47af-a2ab-2be08d299b58', '04d6c34b-1346-4d92-a416-6ab8475700a3', '28900a3e-b7d6-4c36-8dca-22fdde0e9f87'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:13 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-4a4aa220-c686-4111-a322-da9761803578 tempest-GroupSnapshotsTest-365159363 None] group_snapshot 9aef506e-bf80-4eae-87e9-a0f4230900f1: deleted successfully Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Flow 'volume_create_manager' (4ae58136-d7fc-42cb-9de5-0522dd866b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11278e6a-d9af-4972-b8e3-a0e0cd966eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11278e6a-d9af-4972-b8e3-a0e0cd966eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1126560074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212ef177-2c38-4fe7-93db-1249dac6af52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5a92b244f34a5e8304baa2f72e30b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:14Z,use_quota=True,user_id='5fc8e4bc3c8c4ebebe2bb9dadeb42ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4f711b-a129-447e-b6fa-ac69b6db20b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b4f711b-a129-447e-b6fa-ac69b6db20b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43af19fc-04d8-46d2-8a2c-c390b02f2917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43af19fc-04d8-46d2-8a2c-c390b02f2917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '212ef177-2c38-4fe7-93db-1249dac6af52', 'volume_name': 'volume-212ef177-2c38-4fe7-93db-1249dac6af52', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf731f7-d088-4603-ad3f-4598332ac631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf731f7-d088-4603-ad3f-4598332ac631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205db98c-09c6-440b-86a4-25a4dc5c6997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:13 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Volume 212ef177-2c38-4fe7-93db-1249dac6af52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-212ef177-2c38-4fe7-93db-1249dac6af52', 'volume_size': 1} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-4506b2a1-0457-4679-953a-fa1625893450" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-4506b2a1-0457-4679-953a-fa1625893450" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50dfb56-39fe-490e-83fa-3ed07986d6d8]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:13 devstack sudo[86339]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.info" returned: 0 in 0.571s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:14 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.info is being set with open permissions: ugo+rw Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:14 devstack sudo[86342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 Apr 10 12:16:14 devstack sudo[86342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:14 devstack sudo[86348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.info Apr 10 12:16:14 devstack sudo[86348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:14 devstack sudo[86351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:14 devstack sudo[86351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:14 devstack sudo[86342]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450" returned: 0 in 0.606s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:14 devstack sudo[86375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450 Apr 10 12:16:14 devstack sudo[86375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:14 devstack sudo[86348]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.info" returned: 0 in 0.584s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.049s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.763s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:14 devstack sudo[86351]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1126560074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=212ef177-2c38-4fe7-93db-1249dac6af52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e5a92b244f34a5e8304baa2f72e30b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:14Z,use_quota=True,user_id='5fc8e4bc3c8c4ebebe2bb9dadeb42ed2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Creating volume 212ef177-2c38-4fe7-93db-1249dac6af52 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:14 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:14 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 1073741824 Apr 10 12:16:14 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.577s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:14 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-cfac2917-ee03-45ab-9a7e-16b8ae083815 tempest-SnapshotMetadataTestJSON-587453314 None] Create snapshot completed successfully Apr 10 12:16:14 devstack sudo[86375]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4506b2a1-0457-4679-953a-fa1625893450" returned: 0 in 0.465s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-4506b2a1-0457-4679-953a-fa1625893450" released by "delete_volume" :: held 1.108s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Created reservations ['292b65ff-9c5d-4c65-a42d-3e52fb287333'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:15 devstack cinder-volume[82546]: WARNING cinder.db.sqlalchemy.api [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1639200469'] Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Created reservations ['0136a702-c7b7-4cfa-8842-0bb6afdb790d', 'a03d7a11-e17b-4a9a-8d54-58f88e23e38c', '38fa95fa-1518-4721-bfc1-6b08e9551544', '00625f5b-0406-48f6-ba46-c1e820e5b82e'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:15 devstack sudo[86385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:15 devstack sudo[86385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:15 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 1073741824" returned: 0 in 0.552s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:15 devstack sudo[86387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 Apr 10 12:16:15 devstack sudo[86387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:15 devstack sudo[86385]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.427s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:15 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-865590ad-7e64-4ee3-9ebd-f9db7349953b tempest-GroupSnapshotsTest-365159363 None] Delete group completed successfully. Apr 10 12:16:15 devstack sudo[86387]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52" returned: 0 in 0.471s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (205db98c-09c6-440b-86a4-25a4dc5c6997) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-212ef177-2c38-4fe7-93db-1249dac6af52', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92207246-6bb4-4018-8b3e-8807a829e59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:15 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Volume volume-212ef177-2c38-4fe7-93db-1249dac6af52 (212ef177-2c38-4fe7-93db-1249dac6af52): created successfully Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92207246-6bb4-4018-8b3e-8807a829e59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Flow 'volume_create_manager' (4ae58136-d7fc-42cb-9de5-0522dd866b0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:15 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1f0e487a-3956-4e89-a185-96c3c61d570f tempest-VolumesTransfersV357Test-873941983 None] Created volume successfully. Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Acquiring lock "cinder-212ef177-2c38-4fe7-93db-1249dac6af52-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Lock "cinder-212ef177-2c38-4fe7-93db-1249dac6af52-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Acquiring lock "cinder-quobyte-212ef177-2c38-4fe7-93db-1249dac6af52" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Lock "cinder-quobyte-212ef177-2c38-4fe7-93db-1249dac6af52" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03d9c0-ed1a-4363-bda6-acbbd56b10b6]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "cinder-a3f09ec7-3e76-4030-b067-e6411ec0d768-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-a3f09ec7-3e76-4030-b067-e6411ec0d768-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "cinder-quobyte-ac92bae6-bd1a-40af-9e67-fed822c4cd44" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-quobyte-ac92bae6-bd1a-40af-9e67-fed822c4cd44" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "cinder-quobyte-a3f09ec7-3e76-4030-b067-e6411ec0d768" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:16 devstack sudo[86394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 Apr 10 12:16:16 devstack sudo[86394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-quobyte-a3f09ec7-3e76-4030-b067-e6411ec0d768" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Deleting offline snapshot a3f09ec7-3e76-4030-b067-e6411ec0d768 of volume ac92bae6-bd1a-40af-9e67-fed822c4cd44 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] snapshot_file for this snap is: volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ed4d67-28d8-4312-bb8a-6911cd813bd4]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-19a518fd-1706-4bdf-b5d9-f909c2217c82 tempest-GroupSnapshotsTest-365159363 None] Group tempest-GroupSnapshotsTest-Group-270730734: creating Apr 10 12:16:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-19a518fd-1706-4bdf-b5d9-f909c2217c82 tempest-GroupSnapshotsTest-365159363 None] Group tempest-GroupSnapshotsTest-Group-270730734: created successfully Apr 10 12:16:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-19a518fd-1706-4bdf-b5d9-f909c2217c82 tempest-GroupSnapshotsTest-365159363 None] Create group completed successfully. Apr 10 12:16:16 devstack sudo[86396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 Apr 10 12:16:16 devstack sudo[86396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-774af413-ff5c-4d2e-a26d-be5f26cbaa83 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Terminate volume connection completed successfully. Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-774af413-ff5c-4d2e-a26d-be5f26cbaa83 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Deleting attachment 85f4feed-08a2-4dfb-9495-102a7a938ffe. {{(pid=82546) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 12:16:16 devstack sudo[86394]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52" returned: 0 in 0.528s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:16 devstack sudo[86403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52 Apr 10 12:16:16 devstack sudo[86403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:16 devstack sudo[86396]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768" returned: 0 in 0.509s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebdd388-fa2d-4bf2-b8e2-353fd0359ae1]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:16 devstack sudo[86406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 Apr 10 12:16:16 devstack sudo[86406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:17 devstack sudo[86403]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-212ef177-2c38-4fe7-93db-1249dac6af52" returned: 0 in 0.419s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Lock "cinder-quobyte-212ef177-2c38-4fe7-93db-1249dac6af52" released by "delete_volume" :: held 0.982s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Created reservations ['139d1210-12c4-4f4d-8d5b-169325044ca2', 'e57de622-bc95-419d-98ce-961708b4f8f6', '24e26b18-f8ca-4b73-8ea5-a732e2f18517', '10cd7eb7-b934-45f4-96c5-3e82ac956704'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:17 devstack sudo[86414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:17 devstack sudo[86414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "cinder-45286cfd-5c73-45d4-9aa9-8df7d61b746a-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "cinder-45286cfd-5c73-45d4-9aa9-8df7d61b746a-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "cinder-quobyte-45286cfd-5c73-45d4-9aa9-8df7d61b746a" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "cinder-quobyte-45286cfd-5c73-45d4-9aa9-8df7d61b746a" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a544c346-17f9-48c1-8aa9-19abfc32460f]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:17 devstack sudo[86406]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44" returned: 0 in 0.613s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:17 devstack sudo[86420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 Apr 10 12:16:17 devstack sudo[86420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:17 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:16:17 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Flow 'volume_create_manager' (94d5f54e-e669-47e9-ba78-7c6b6294df19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8e03c6-8517-497e-9a0e-87cddac28c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd8e03c6-8517-497e-9a0e-87cddac28c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531120377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=329ba6fa-8438-4cbc-9834-fc518ff3c605,host='devstack@QuobyteHD#QuobyteHD',id=766e7f3e-26a9-4feb-ba97-12a39c961d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853307c8a4744284a853616d0a1fe9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:18Z,use_quota=True,user_id='4070d4c57a25435aa94f1112e8798dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f5b8602-526f-4341-ad84-1d179334784c),volume_type_id=9f5b8602-526f-4341-ad84-1d179334784c)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a203a0-b918-4276-b76f-3ff04881864d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73a203a0-b918-4276-b76f-3ff04881864d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b470629-b7ab-4b5a-864e-aef04bdf3ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b470629-b7ab-4b5a-864e-aef04bdf3ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '766e7f3e-26a9-4feb-ba97-12a39c961d34', 'volume_name': 'volume-766e7f3e-26a9-4feb-ba97-12a39c961d34', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b0e28c-45b0-4607-b837-975a7f196c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7b0e28c-45b0-4607-b837-975a7f196c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2337164-280a-4cda-8f13-8ac3f19541f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:17 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Volume 766e7f3e-26a9-4feb-ba97-12a39c961d34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-766e7f3e-26a9-4feb-ba97-12a39c961d34', 'volume_size': 1} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=329ba6fa-8438-4cbc-9834-fc518ff3c605,created_at=2026-04-10T10:16:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-531120377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=329ba6fa-8438-4cbc-9834-fc518ff3c605,host='devstack@QuobyteHD#QuobyteHD',id=766e7f3e-26a9-4feb-ba97-12a39c961d34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853307c8a4744284a853616d0a1fe9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:18Z,use_quota=True,user_id='4070d4c57a25435aa94f1112e8798dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f5b8602-526f-4341-ad84-1d179334784c),volume_type_id=9f5b8602-526f-4341-ad84-1d179334784c)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Creating volume 766e7f3e-26a9-4feb-ba97-12a39c961d34 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:17 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:17 devstack sudo[86414]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.659s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:17 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:17 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Deleted volume successfully. Apr 10 12:16:17 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 1073741824 Apr 10 12:16:17 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-29384905-5c5d-465f-8e0d-7d9196c7a7e5 tempest-VolumesTransfersV357Test-812684738 None] Lock "cinder-212ef177-2c38-4fe7-93db-1249dac6af52-delete_volume" released by "delete_volume" :: held 1.807s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:18 devstack sudo[86420]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768" returned: 0 in 0.708s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:18 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 0 in 0.765s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:18 devstack sudo[86431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768 Apr 10 12:16:18 devstack sudo[86431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:18 devstack sudo[86432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:16:18 devstack sudo[86432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:18 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 1073741824" returned: 0 in 0.630s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:18 devstack sudo[86439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 Apr 10 12:16:18 devstack sudo[86439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:18 devstack sudo[86431]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44.a3f09ec7-3e76-4030-b067-e6411ec0d768" returned: 0 in 0.516s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-quobyte-a3f09ec7-3e76-4030-b067-e6411ec0d768" released by "_delete_snapshot" :: held 2.420s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-quobyte-ac92bae6-bd1a-40af-9e67-fed822c4cd44" released by "delete_snapshot" :: held 2.433s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Created reservations ['31100c90-a958-4c97-9b32-214f5fc72759', 'fd3f4b57-d51b-4900-a72d-b7cfaf041328', '27958e30-3993-4b40-a6ab-b3471cbec9dc', '6d16cd14-a3ce-486a-a697-e93cfdbbea49'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:18 devstack sudo[86432]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 1 in 0.612s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:18 devstack sudo[86445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a Apr 10 12:16:18 devstack sudo[86445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:18 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Delete snapshot completed successfully. Apr 10 12:16:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18e662c9-5640-4b3d-bf2f-411bb6bb20fe tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-a3f09ec7-3e76-4030-b067-e6411ec0d768-delete_snapshot" released by "delete_snapshot" :: held 2.588s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:19 devstack sudo[86439]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34" returned: 0 in 0.599s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2337164-280a-4cda-8f13-8ac3f19541f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-766e7f3e-26a9-4feb-ba97-12a39c961d34', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665e0e0f-6ebf-480b-9459-64dcdd835f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:19 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Volume volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 (766e7f3e-26a9-4feb-ba97-12a39c961d34): created successfully Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (665e0e0f-6ebf-480b-9459-64dcdd835f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Flow 'volume_create_manager' (94d5f54e-e669-47e9-ba78-7c6b6294df19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:19 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-da75bcfe-df18-453e-b5d4-8049d84ece9f tempest-GroupSnapshotsTest-365159363 None] Created volume successfully. Apr 10 12:16:19 devstack sudo[86445]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-45286cfd-5c73-45d4-9aa9-8df7d61b746a" returned: 0 in 0.488s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "cinder-quobyte-45286cfd-5c73-45d4-9aa9-8df7d61b746a" released by "delete_volume" :: held 1.926s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.quota [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Created reservations ['0d661529-50bf-42ff-8b72-b6d6c497d484', 'ffdbb06c-8170-4faa-98ca-38613719dd3d', '92903600-fbad-4418-b56d-9ae98f607ffa', 'de968156-1fb6-4090-8235-a56fca3735e5'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:19 devstack sudo[86449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:19 devstack sudo[86449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "cinder-ac92bae6-bd1a-40af-9e67-fed822c4cd44-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-ac92bae6-bd1a-40af-9e67-fed822c4cd44-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "cinder-quobyte-ac92bae6-bd1a-40af-9e67-fed822c4cd44" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-quobyte-ac92bae6-bd1a-40af-9e67-fed822c4cd44" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c11e2be-8d9b-476e-95b4-0beb086278df]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:19 devstack sudo[86453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 Apr 10 12:16:19 devstack sudo[86453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:19 devstack sudo[86449]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.467s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.manager [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:19 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Deleted volume successfully. Apr 10 12:16:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-47d8a422-1dd0-4bdf-af4b-0cc75bf0a780 req-450a4a2a-7071-4130-8e26-1276635cf7fe tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "cinder-45286cfd-5c73-45d4-9aa9-8df7d61b746a-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:20 devstack sudo[86453]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44" returned: 0 in 0.628s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:20 devstack sudo[86459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44 Apr 10 12:16:20 devstack sudo[86459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Flow 'volume_create_manager' (563938b0-2c06-46de-8f30-0dff7aa78124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0397cf-e59e-44ba-bb09-e513ad4f986e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd0397cf-e59e-44ba-bb09-e513ad4f986e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1994589028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=329ba6fa-8438-4cbc-9834-fc518ff3c605,host='devstack@QuobyteHD#QuobyteHD',id=6d545509-2269-46ba-af34-8f1e3ee4d418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853307c8a4744284a853616d0a1fe9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:20Z,use_quota=True,user_id='4070d4c57a25435aa94f1112e8798dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f5b8602-526f-4341-ad84-1d179334784c),volume_type_id=9f5b8602-526f-4341-ad84-1d179334784c)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0179a92f-dea7-4de5-94fb-d14580b70b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0179a92f-dea7-4de5-94fb-d14580b70b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ae98f3-77a3-4bc4-ae29-e33a8488d81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93ae98f3-77a3-4bc4-ae29-e33a8488d81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d545509-2269-46ba-af34-8f1e3ee4d418', 'volume_name': 'volume-6d545509-2269-46ba-af34-8f1e3ee4d418', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4b4616-1105-4b01-98a5-d733b8b59846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b4b4616-1105-4b01-98a5-d733b8b59846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0198f7-4f01-476c-9d91-8eb4c73fe584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:20 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Volume 6d545509-2269-46ba-af34-8f1e3ee4d418: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d545509-2269-46ba-af34-8f1e3ee4d418', 'volume_size': 1} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=329ba6fa-8438-4cbc-9834-fc518ff3c605,created_at=2026-04-10T10:16:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1994589028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=329ba6fa-8438-4cbc-9834-fc518ff3c605,host='devstack@QuobyteHD#QuobyteHD',id=6d545509-2269-46ba-af34-8f1e3ee4d418,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853307c8a4744284a853616d0a1fe9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:20Z,use_quota=True,user_id='4070d4c57a25435aa94f1112e8798dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f5b8602-526f-4341-ad84-1d179334784c),volume_type_id=9f5b8602-526f-4341-ad84-1d179334784c)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Creating volume 6d545509-2269-46ba-af34-8f1e3ee4d418 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:20 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:20 devstack sudo[86461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 1073741824 Apr 10 12:16:20 devstack sudo[86461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:20 devstack sudo[86459]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ac92bae6-bd1a-40af-9e67-fed822c4cd44" returned: 0 in 0.509s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-quobyte-ac92bae6-bd1a-40af-9e67-fed822c4cd44" released by "delete_volume" :: held 1.188s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Created reservations ['85621718-4f4d-466b-99a2-a499df4c6ac6', '94ec0e97-614a-4a11-b351-55d1075e6314', 'de613bc0-bdda-49c8-baad-cc8451e2e59e', '4d67c434-3a9d-43ac-85a3-62aa4216c341'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:20 devstack sudo[86467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:20 devstack sudo[86467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:21 devstack sudo[86461]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 1073741824" returned: 0 in 0.670s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:21 devstack sudo[86470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 Apr 10 12:16:21 devstack sudo[86470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Flow 'volume_create_manager' (23cf1311-da12-4ceb-b596-f5cd68c0cc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80df5804-08db-4f21-9943-7d63c3467d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80df5804-08db-4f21-9943-7d63c3467d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1521853552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e018cc53-9c60-4664-8950-0894949bb082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62c9e99f455448ab948df5f37a9cfb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:21Z,use_quota=True,user_id='59796d8ae9dc4ff98ce35af389547c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017fab14-85a3-424f-b910-44e2ce3e33c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (017fab14-85a3-424f-b910-44e2ce3e33c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61773ed-0cef-47c5-9624-e42ff09d5f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f61773ed-0cef-47c5-9624-e42ff09d5f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e018cc53-9c60-4664-8950-0894949bb082', 'volume_name': 'volume-e018cc53-9c60-4664-8950-0894949bb082', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af937b62-5924-49e2-b2f6-a7e6b683fb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af937b62-5924-49e2-b2f6-a7e6b683fb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e854ac-b2c7-4c6f-8710-72b1a4b740d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:21 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Volume e018cc53-9c60-4664-8950-0894949bb082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e018cc53-9c60-4664-8950-0894949bb082', 'volume_size': 1} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:21 devstack sudo[86467]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.481s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Deleted volume successfully. Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c21f273-7d9f-43ea-9623-83865337a593 tempest-SnapshotMetadataTestJSON-587453314 None] Lock "cinder-ac92bae6-bd1a-40af-9e67-fed822c4cd44-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:21 devstack sudo[86470]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.262s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1521853552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e018cc53-9c60-4664-8950-0894949bb082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62c9e99f455448ab948df5f37a9cfb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:21Z,use_quota=True,user_id='59796d8ae9dc4ff98ce35af389547c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Creating volume e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:21 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:21 devstack sudo[86474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 1073741824 Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0198f7-4f01-476c-9d91-8eb4c73fe584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d545509-2269-46ba-af34-8f1e3ee4d418', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:21 devstack sudo[86474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e640e0-aec1-4777-83f9-85dd82a1fe35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:21 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Volume volume-6d545509-2269-46ba-af34-8f1e3ee4d418 (6d545509-2269-46ba-af34-8f1e3ee4d418): created successfully Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2e640e0-aec1-4777-83f9-85dd82a1fe35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Flow 'volume_create_manager' (563938b0-2c06-46de-8f30-0dff7aa78124) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b08c9ee0-33bd-4744-9bf3-900efae74532 tempest-GroupSnapshotsTest-365159363 None] Created volume successfully. Apr 10 12:16:22 devstack sudo[86474]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 1073741824" returned: 0 in 0.721s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:22 devstack sudo[86502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 Apr 10 12:16:22 devstack sudo[86502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:22 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-29c0f169-dd68-4a2c-bee5-c5fb0b8b0740 tempest-GroupSnapshotsTest-365159363 None] Update group completed successfully. Apr 10 12:16:22 devstack sudo[86502]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082" returned: 0 in 0.527s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1e854ac-b2c7-4c6f-8710-72b1a4b740d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e018cc53-9c60-4664-8950-0894949bb082', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1733ed-5316-47fe-b5a7-a187592a26f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:22 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Volume volume-e018cc53-9c60-4664-8950-0894949bb082 (e018cc53-9c60-4664-8950-0894949bb082): created successfully Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1733ed-5316-47fe-b5a7-a187592a26f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Flow 'volume_create_manager' (23cf1311-da12-4ceb-b596-f5cd68c0cc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:22 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e3e5f3d8-2668-48ab-8d24-f07cc493de32 tempest-VolumesCloneTest-979944428 None] Created volume successfully. Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Flow 'volume_create_manager' (ccee0ac2-eb6d-4493-ab7c-60c627fffcf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b24d6a7-11d7-4da1-a908-0dc6e015d2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:23 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-dc51b670-b54e-4a84-b54e-aca278b99a57 tempest-GroupSnapshotsTest-365159363 None] Update group completed successfully. Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b24d6a7-11d7-4da1-a908-0dc6e015d2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-178538054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb64bd84-fb78-4d6f-80f9-4f2c370a21c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e62c9e99f455448ab948df5f37a9cfb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:24Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=e018cc53-9c60-4664-8950-0894949bb082,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:24Z,use_quota=True,user_id='59796d8ae9dc4ff98ce35af389547c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02dc2ed-e908-46f0-861b-04077135354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b02dc2ed-e908-46f0-861b-04077135354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032eb287-8a82-43fd-9c90-5c2533c43d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (032eb287-8a82-43fd-9c90-5c2533c43d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'fb64bd84-fb78-4d6f-80f9-4f2c370a21c2', 'volume_name': 'volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2', 'volume_size': 2, 'source_volid': 'e018cc53-9c60-4664-8950-0894949bb082', 'source_volstatus': 'available'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d2d02b-abe6-4830-80e5-4011f2cd070e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d2d02b-abe6-4830-80e5-4011f2cd070e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd78fdbf-e6b8-4ebe-8ca2-9f0112a0a7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:23 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Volume fb64bd84-fb78-4d6f-80f9-4f2c370a21c2: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2', 'volume_size': 2, 'source_volid': 'e018cc53-9c60-4664-8950-0894949bb082', 'source_volstatus': 'available'} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:23 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Cloning volume e018cc53-9c60-4664-8950-0894949bb082 to volume fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Creating offline snapshot e11a773b-aac5-4160-97d1-b0365b6187ca of volume e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[878dc7e9-cd11-4d23-a522-251caa7659fe]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:24 devstack sudo[86512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 Apr 10 12:16:24 devstack sudo[86512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:24 devstack sudo[86512]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082" returned: 0 in 0.560s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:24 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca 1G Apr 10 12:16:24 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:24 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-84260fe8-97c6-4f0f-a703-855991693753 tempest-GroupSnapshotsTest-365159363 None] Update group completed successfully. Apr 10 12:16:25 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca 1G" returned: 0 in 0.616s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e018cc53-9c60-4664-8950-0894949bb082 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:25 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e018cc53-9c60-4664-8950-0894949bb082 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca Apr 10 12:16:25 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:25 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e018cc53-9c60-4664-8950-0894949bb082 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca" returned: 0 in 0.481s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:25 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca is being set with open permissions: ugo+rw Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:25 devstack sudo[86529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca Apr 10 12:16:25 devstack sudo[86529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Flow 'volume_create_manager' (d22c870f-0b5d-4b82-a28c-21af31dc7ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78bf7dc-a556-4595-a072-0ef3dd477b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78bf7dc-a556-4595-a072-0ef3dd477b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1416394944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68087231-1793-41c0-9a8f-037a450f3cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4958b7c3d34c5d9a1ce032708e2d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:26Z,use_quota=True,user_id='e0a573cb90a14e02802f847fa04fb651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb1ad9b-8b6c-49a6-b7f8-c05f37f715c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cb1ad9b-8b6c-49a6-b7f8-c05f37f715c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e3fd23-ecc2-4255-a59f-f130611ea4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50e3fd23-ecc2-4255-a59f-f130611ea4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68087231-1793-41c0-9a8f-037a450f3cb8', 'volume_name': 'volume-68087231-1793-41c0-9a8f-037a450f3cb8', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35609e01-7160-42e7-90dc-b10973b3e770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35609e01-7160-42e7-90dc-b10973b3e770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8819e028-bef9-46f7-84e8-cf4bda205f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:25 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Volume 68087231-1793-41c0-9a8f-037a450f3cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68087231-1793-41c0-9a8f-037a450f3cb8', 'volume_size': 1} Apr 10 12:16:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:26 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2e54aa08-fb0c-4ca7-ac6f-d2b929027d38 tempest-GroupSnapshotsTest-365159363 None] Update group completed successfully. Apr 10 12:16:26 devstack sudo[86529]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca" returned: 0 in 0.494s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:26 devstack sudo[86532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.info Apr 10 12:16:26 devstack sudo[86532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:26 devstack sudo[86532]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.info" returned: 0 in 0.430s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:26 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.info is being set with open permissions: ugo+rw Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:26 devstack sudo[86535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.info Apr 10 12:16:26 devstack sudo[86535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:26 devstack sudo[86535]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.info" returned: 0 in 0.437s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Acquiring lock "cinder-quobyte-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Lock "cinder-quobyte-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] snapshot: e11a773b-aac5-4160-97d1-b0365b6187ca, volume: fb64bd84-fb78-4d6f-80f9-4f2c370a21c2, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[818571ce-461a-41db-bb23-afd751381ffa]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:27 devstack sudo[86538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca Apr 10 12:16:27 devstack sudo[86538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:27 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] GroupSnapshot 0e7bca5d-4b56-4a61-a7e0-e5f8e499716f: creating. Apr 10 12:16:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Group snapshot 0e7bca5d-4b56-4a61-a7e0-e5f8e499716f: creating. {{(pid=82546) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 12:16:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:27 devstack sudo[86538]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca" returned: 0 in 0.516s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e018cc53-9c60-4664-8950-0894949bb082(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:16:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:16:27 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a89b294-0969-466c-8cb5-faa552281d70]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:27 devstack sudo[86543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 Apr 10 12:16:27 devstack sudo[86543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:28 devstack sudo[86543]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:28 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:16:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:28 devstack sudo[86549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 Apr 10 12:16:28 devstack sudo[86549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:30 devstack sudo[86549]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" returned: 0 in 2.402s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:30 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[72dca6a6-ac1a-486e-839e-4eb02df100f7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:30 devstack sudo[86589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 Apr 10 12:16:30 devstack sudo[86589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:31 devstack sudo[86589]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082" returned: 0 in 0.636s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082, size 1024.00 MB, duration 2.40 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:16:31 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Converted 1024.00 MB image at 425.97 MB/s Apr 10 12:16:31 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 is being set with open permissions: ugo+rw Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:31 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 Apr 10 12:16:31 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:31 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" returned: 0 in 0.432s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Lock "cinder-quobyte-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" released by "_copy_volume_from_snapshot" :: held 4.523s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=193,cinder:INSERT=53,cinder:UPDATE=224,cinder:DELETE=17 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Acquiring lock "cinder-quobyte-e11a773b-aac5-4160-97d1-b0365b6187ca" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Lock "cinder-quobyte-e11a773b-aac5-4160-97d1-b0365b6187ca" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Deleting offline snapshot e11a773b-aac5-4160-97d1-b0365b6187ca of volume e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] snapshot_file for this snap is: volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[779c8ce6-7d3b-49d2-a6ef-5e3b2d20abd4]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:31 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca Apr 10 12:16:31 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:UPDATE=198,cinder:DELETE=15,cinder:SELECT=167,cinder:INSERT=55 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:16:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-af2a121c-0efb-422f-bf33-147051260aac req-49682260-446f-40d2-ac4d-eb12904af372 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Terminate volume connection completed successfully. Apr 10 12:16:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [req-af2a121c-0efb-422f-bf33-147051260aac req-49682260-446f-40d2-ac4d-eb12904af372 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Deleting attachment 2f002bd9-00f1-4917-8915-6c35bb78d559. {{(pid=82546) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 10 12:16:32 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e018cc53-9c60-4664-8950-0894949bb082(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa1bd6b-88ea-43d6-845f-95e3ba02cb85]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:32 devstack sudo[86604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 Apr 10 12:16:32 devstack sudo[86604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "cinder-d412c730-cc73-4037-8e68-a1d116934479-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "cinder-d412c730-cc73-4037-8e68-a1d116934479-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "cinder-quobyte-d412c730-cc73-4037-8e68-a1d116934479" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "cinder-quobyte-d412c730-cc73-4037-8e68-a1d116934479" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0d23b97-fc6b-4de9-9afd-78def4f64b94]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:32 devstack sudo[86604]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082" returned: 0 in 0.507s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:32 devstack sudo[86609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 Apr 10 12:16:32 devstack sudo[86609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:32 devstack sudo[86611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca Apr 10 12:16:32 devstack sudo[86611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:32 devstack sudo[86609]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479" returned: 0 in 0.490s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:32 devstack sudo[86619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479 Apr 10 12:16:32 devstack sudo[86619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:33 devstack sudo[86611]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca" returned: 0 in 0.483s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:33 devstack sudo[86621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca Apr 10 12:16:33 devstack sudo[86621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:33 devstack sudo[86619]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d412c730-cc73-4037-8e68-a1d116934479" returned: 0 in 0.427s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "cinder-quobyte-d412c730-cc73-4037-8e68-a1d116934479" released by "delete_volume" :: held 0.945s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.quota [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Created reservations ['5dacef09-0b6a-4529-af17-2e5e85591d05', '7f8aff55-14eb-4b2c-988a-0b54cbd9745a', '78911950-431c-4763-9e3d-97c57e51e8cf', 'fc2fc728-a543-46b8-a402-a05a1f3f7ad5'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:33 devstack sudo[86621]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082.e11a773b-aac5-4160-97d1-b0365b6187ca" returned: 0 in 0.424s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Lock "cinder-quobyte-e11a773b-aac5-4160-97d1-b0365b6187ca" released by "_delete_snapshot" :: held 1.941s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.610s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.523s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1416394944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68087231-1793-41c0-9a8f-037a450f3cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4958b7c3d34c5d9a1ce032708e2d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:26Z,use_quota=True,user_id='e0a573cb90a14e02802f847fa04fb651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Creating volume 68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:33 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:33 devstack sudo[86625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 1073741824 Apr 10 12:16:33 devstack sudo[86625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd78fdbf-e6b8-4ebe-8ca2-9f0112a0a7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2', 'volume_size': 2, 'source_volid': 'e018cc53-9c60-4664-8950-0894949bb082', 'source_volstatus': 'available'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4e1088-6b2a-44a8-bc66-33c87ad17f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:33 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:33 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:33 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Volume volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 (fb64bd84-fb78-4d6f-80f9-4f2c370a21c2): created successfully Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4e1088-6b2a-44a8-bc66-33c87ad17f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Flow 'volume_create_manager' (ccee0ac2-eb6d-4493-ab7c-60c627fffcf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:33 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-8b1b382b-ae98-4754-a455-8919c5c092a5 tempest-VolumesCloneTest-979944428 None] Created volume successfully. Apr 10 12:16:33 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.439s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.manager [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:33 devstack cinder-volume[82546]: INFO cinder.volume.manager [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Deleted volume successfully. Apr 10 12:16:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [req-af2a121c-0efb-422f-bf33-147051260aac req-075371ad-0761-4ca3-a62b-10b36f15bfb5 tempest-ServerBootFromVolumeStableRescueTest-1262163526 None] Lock "cinder-d412c730-cc73-4037-8e68-a1d116934479-delete_volume" released by "delete_volume" :: held 1.604s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:34 devstack sudo[86625]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 1073741824" returned: 0 in 0.536s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:34 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 Apr 10 12:16:34 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Acquiring lock "cinder-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Lock "cinder-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Acquiring lock "cinder-quobyte-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Lock "cinder-quobyte-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e987318-84e1-4460-8a69-cdd0c36d54a3]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:34 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.241s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8819e028-bef9-46f7-84e8-cf4bda205f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68087231-1793-41c0-9a8f-037a450f3cb8', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9c4b49-4e95-4968-aeeb-17c8010beba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Creating offline snapshot 7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 of volume 766e7f3e-26a9-4feb-ba97-12a39c961d34 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:16:34 devstack sudo[86637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 Apr 10 12:16:34 devstack sudo[86637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:34 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Volume volume-68087231-1793-41c0-9a8f-037a450f3cb8 (68087231-1793-41c0-9a8f-037a450f3cb8): created successfully Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e9c4b49-4e95-4968-aeeb-17c8010beba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Flow 'volume_create_manager' (d22c870f-0b5d-4b82-a28c-21af31dc7ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c65f0e8-000c-452e-bc0f-755853ec7597]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:34 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-acb5407a-50b0-4d29-8240-071f6eeb982b tempest-VolumesDeleteCascade-298236656 None] Created volume successfully. Apr 10 12:16:34 devstack sudo[86639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 Apr 10 12:16:34 devstack sudo[86639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:35 devstack sudo[86637]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" returned: 0 in 0.540s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:35 devstack sudo[86648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2 Apr 10 12:16:35 devstack sudo[86648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:35 devstack sudo[86639]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34" returned: 0 in 0.560s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:35 devstack sudo[86650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 1G Apr 10 12:16:35 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:35 devstack sudo[86648]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" returned: 0 in 0.445s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Lock "cinder-quobyte-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2" released by "delete_volume" :: held 1.009s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Created reservations ['27093207-8b69-408d-8f5e-4383e73b2a47', '1a9a7823-2e30-40a4-a944-af35bffa3ec7', 'c6842106-1b12-4ff3-897f-b7affb2ce025', '0668c7e8-5cad-473e-bfca-df3ac45354d1'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:35 devstack sudo[86656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:35 devstack sudo[86656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:35 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 1G" returned: 0 in 0.548s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:35 devstack sudo[86658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 Apr 10 12:16:35 devstack sudo[86658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:36 devstack sudo[86656]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.490s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:36 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Deleted volume successfully. Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4ea5951d-0888-4fd6-85a3-14fccc6962d4 tempest-VolumesCloneTest-979944428 None] Lock "cinder-fb64bd84-fb78-4d6f-80f9-4f2c370a21c2-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:36 devstack sudo[86658]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2" returned: 0 in 0.585s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:36 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:36 devstack sudo[86691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 Apr 10 12:16:36 devstack sudo[86691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Acquiring lock "cinder-e018cc53-9c60-4664-8950-0894949bb082-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Lock "cinder-e018cc53-9c60-4664-8950-0894949bb082-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Acquiring lock "cinder-quobyte-e018cc53-9c60-4664-8950-0894949bb082" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Lock "cinder-quobyte-e018cc53-9c60-4664-8950-0894949bb082" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[09324ae3-c17b-4f12-b35f-1fcd84d2f028]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:36 devstack sudo[86691]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2" returned: 0 in 0.521s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:36 devstack sudo[86696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 Apr 10 12:16:36 devstack sudo[86696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:36 devstack sudo[86697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.info Apr 10 12:16:36 devstack sudo[86697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:37 devstack sudo[86697]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.info" returned: 0 in 0.470s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:37 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:37 devstack sudo[86708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.info Apr 10 12:16:37 devstack sudo[86708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:37 devstack sudo[86696]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082" returned: 0 in 0.616s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:37 devstack sudo[86710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082 Apr 10 12:16:37 devstack sudo[86710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:37 devstack sudo[86708]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.info" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.253s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Creating offline snapshot c44bf114-47fe-48f9-a0f9-7b09f31309b4 of volume 6d545509-2269-46ba-af34-8f1e3ee4d418 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bef93b-2091-47b2-a684-27e3f8f5d1b8]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:37 devstack sudo[86710]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e018cc53-9c60-4664-8950-0894949bb082" returned: 0 in 0.506s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Lock "cinder-quobyte-e018cc53-9c60-4664-8950-0894949bb082" released by "delete_volume" :: held 1.161s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:37 devstack sudo[86715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 Apr 10 12:16:37 devstack sudo[86715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Created reservations ['bd7687ba-070c-4f68-b144-7b151bcc63dd', '7730585f-9771-4a57-87de-007cd2612f67', 'fa0744a2-518b-4d6d-a073-e314b3d50b36', '74de3d2d-4243-463d-8de5-b0ca2cfeb6c2'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:37 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:37 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:38 devstack sudo[86715]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418" returned: 0 in 0.514s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:38 devstack sudo[86723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 1G Apr 10 12:16:38 devstack sudo[86723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:38 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.423s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:38 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:38 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Deleted volume successfully. Apr 10 12:16:38 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9ea39d82-3123-429c-9212-131a6a00a84f tempest-VolumesCloneTest-979944428 None] Lock "cinder-e018cc53-9c60-4664-8950-0894949bb082-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:38 devstack sudo[86723]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 1G" returned: 0 in 0.517s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d545509-2269-46ba-af34-8f1e3ee4d418 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:38 devstack sudo[86728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d545509-2269-46ba-af34-8f1e3ee4d418 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 Apr 10 12:16:38 devstack sudo[86728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:39 devstack sudo[86728]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d545509-2269-46ba-af34-8f1e3ee4d418 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4" returned: 0 in 0.511s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:39 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:16:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:39 devstack sudo[86733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 Apr 10 12:16:39 devstack sudo[86733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:39 devstack sudo[86733]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4" returned: 0 in 0.453s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:39 devstack sudo[86736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.info Apr 10 12:16:39 devstack sudo[86736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:40 devstack sudo[86736]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.info" returned: 0 in 0.441s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:40 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:40 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.info Apr 10 12:16:40 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Flow 'volume_create_manager' (529510e8-6f20-4af6-bed6-66d8ba3ea780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a3da2-e6ca-4975-bf0c-f353556dafc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (848a3da2-e6ca-4975-bf0c-f353556dafc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-655644853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0aac31-8441-4138-b5c4-fc8d1fee730b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5e5b87e375b45cd9112bf311b365a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:40Z,use_quota=True,user_id='7cfd204026164749b7fb8bd2c045485b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd869b8c-e18c-49af-87fe-8c49b06c9353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd869b8c-e18c-49af-87fe-8c49b06c9353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cac2861-8969-45c7-8310-300d57c9b26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cac2861-8969-45c7-8310-300d57c9b26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a0aac31-8441-4138-b5c4-fc8d1fee730b', 'volume_name': 'volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876d6c7e-a49a-4b19-8cf9-c53259b8f966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (876d6c7e-a49a-4b19-8cf9-c53259b8f966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7640a921-e6e5-4cce-af05-1dde56c62cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:40 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Volume 6a0aac31-8441-4138-b5c4-fc8d1fee730b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b', 'volume_size': 1} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:40 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.info" returned: 0 in 0.421s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.916s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.053s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Creating offline snapshot 78dbbde6-bd18-4fb8-b7fc-10dd755389d4 of volume 68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0b6c30-649d-4309-a55c-3c67d138c70b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:40 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-003b33f5-2c14-4095-9c0c-80b3c008b466 tempest-GroupSnapshotsTest-365159363 None] group_snapshot 0e7bca5d-4b56-4a61-a7e0-e5f8e499716f: created successfully Apr 10 12:16:40 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 Apr 10 12:16:40 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:41 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8" returned: 0 in 0.508s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:41 devstack sudo[86747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 1G Apr 10 12:16:41 devstack sudo[86747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:41 devstack sudo[86747]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 1G" returned: 0 in 0.554s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:41 devstack sudo[86753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 Apr 10 12:16:41 devstack sudo[86753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] group_snapshot 0e7bca5d-4b56-4a61-a7e0-e5f8e499716f: deleting Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] group_snapshot 0e7bca5d-4b56-4a61-a7e0-e5f8e499716f: deleting {{(pid=82546) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-766e7f3e-26a9-4feb-ba97-12a39c961d34" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-766e7f3e-26a9-4feb-ba97-12a39c961d34" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Deleting offline snapshot 7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 of volume 766e7f3e-26a9-4feb-ba97-12a39c961d34 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] snapshot_file for this snap is: volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb7beb5-7b52-4d7f-b3f8-1084dde918f4]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:42 devstack sudo[86755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 Apr 10 12:16:42 devstack sudo[86755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:42 devstack sudo[86753]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4" returned: 0 in 0.516s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:42 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 is being set with open permissions: ugo+rw Apr 10 12:16:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:42 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 Apr 10 12:16:42 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:42 devstack sudo[86755]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2" returned: 0 in 0.572s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-766e7f3e-26a9-4feb-ba97-12a39c961d34(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:42 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd9c3bbc-0f7e-459c-8b9a-bb7eea2a47e1]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:42 devstack sudo[86766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 Apr 10 12:16:42 devstack sudo[86766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:42 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:42 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.info Apr 10 12:16:42 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:43 devstack sudo[86766]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34" returned: 0 in 0.555s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:43 devstack sudo[86774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 Apr 10 12:16:43 devstack sudo[86774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:43 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.info" returned: 0 in 0.524s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:43 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.info is being set with open permissions: ugo+rw Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:43 devstack sudo[86777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.info Apr 10 12:16:43 devstack sudo[86777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:43 devstack sudo[86774]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:43 devstack sudo[86783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2 Apr 10 12:16:43 devstack sudo[86783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:43 devstack sudo[86777]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.info" returned: 0 in 0.506s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.091s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.204s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-655644853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a0aac31-8441-4138-b5c4-fc8d1fee730b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5e5b87e375b45cd9112bf311b365a37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:40Z,use_quota=True,user_id='7cfd204026164749b7fb8bd2c045485b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Creating volume 6a0aac31-8441-4138-b5c4-fc8d1fee730b {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:43 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:43 devstack sudo[86792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b 1073741824 Apr 10 12:16:43 devstack sudo[86792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:43 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-30c0104e-cb02-4c83-bfa2-64f6c94d7458 tempest-VolumesDeleteCascade-298236656 None] Create snapshot completed successfully Apr 10 12:16:44 devstack sudo[86783]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34.7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2" returned: 0 in 0.464s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-7adea2a5-a8d1-4486-9c9c-050b0a6ce4e2" released by "_delete_snapshot" :: held 2.170s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-766e7f3e-26a9-4feb-ba97-12a39c961d34" released by "delete_snapshot" :: held 2.183s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-6d545509-2269-46ba-af34-8f1e3ee4d418" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-6d545509-2269-46ba-af34-8f1e3ee4d418" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-c44bf114-47fe-48f9-a0f9-7b09f31309b4" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-c44bf114-47fe-48f9-a0f9-7b09f31309b4" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Deleting offline snapshot c44bf114-47fe-48f9-a0f9-7b09f31309b4 of volume 6d545509-2269-46ba-af34-8f1e3ee4d418 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] snapshot_file for this snap is: volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ac6f2f-0198-4524-b609-b31c02a98476]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:44 devstack sudo[86796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 Apr 10 12:16:44 devstack sudo[86796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:44 devstack sudo[86792]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b 1073741824" returned: 0 in 0.573s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:44 devstack sudo[86801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b Apr 10 12:16:44 devstack sudo[86801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:44 devstack sudo[86796]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4" returned: 0 in 0.565s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d545509-2269-46ba-af34-8f1e3ee4d418(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3116247-103b-4b9d-b9ee-fe68bbd29939]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:44 devstack sudo[86807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 Apr 10 12:16:44 devstack sudo[86807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:44 devstack sudo[86801]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b" returned: 0 in 0.464s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7640a921-e6e5-4cce-af05-1dde56c62cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3545af8-7a03-4084-87a8-a655381844f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:44 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Volume volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b (6a0aac31-8441-4138-b5c4-fc8d1fee730b): created successfully Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3545af8-7a03-4084-87a8-a655381844f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Flow 'volume_create_manager' (529510e8-6f20-4af6-bed6-66d8ba3ea780) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:44 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-5191a153-b933-4a99-bb38-a24dc5b33288 tempest-VolumesNegativeTest-2033599011 None] Created volume successfully. Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Creating offline snapshot f474b22e-7bc2-40ee-830d-7233374f81c6 of volume 68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1dbd46-eeff-400f-9577-308c5850405f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:45 devstack sudo[86809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 Apr 10 12:16:45 devstack sudo[86809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:45 devstack sudo[86807]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418" returned: 0 in 0.541s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:45 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 Apr 10 12:16:45 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Flow 'volume_create_manager' (3e329659-19fd-479d-a99d-d57501e20bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bf5046-1afc-48b6-9c81-d45bdb3388ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3bf5046-1afc-48b6-9c81-d45bdb3388ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1150613448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406a37cb-af7b-48ae-9640-588b2610dfe0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d23f1c15ad504f73a6d07461905bc7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:46Z,use_quota=True,user_id='2e49bbb768404eddb9e5012e328a8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129b4ffa-9a3a-41b1-b60a-b4dca8199893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129b4ffa-9a3a-41b1-b60a-b4dca8199893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5515b3f8-854d-4b93-b5fb-c35ce14cd7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5515b3f8-854d-4b93-b5fb-c35ce14cd7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '406a37cb-af7b-48ae-9640-588b2610dfe0', 'volume_name': 'volume-406a37cb-af7b-48ae-9640-588b2610dfe0', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bcde82-d32d-4ffe-b189-af842850dfac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15bcde82-d32d-4ffe-b189-af842850dfac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12254ec7-63cd-42ca-aa6d-cb9c3d9661d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:45 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Volume 406a37cb-af7b-48ae-9640-588b2610dfe0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-406a37cb-af7b-48ae-9640-588b2610dfe0', 'volume_size': 1} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:45 devstack sudo[86809]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4" returned: 0 in 0.585s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68087231-1793-41c0-9a8f-037a450f3cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:45 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 1G Apr 10 12:16:45 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:45 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:45 devstack sudo[86824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4 Apr 10 12:16:45 devstack sudo[86824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:46 devstack sudo[86824]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418.c44bf114-47fe-48f9-a0f9-7b09f31309b4" returned: 0 in 0.482s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-c44bf114-47fe-48f9-a0f9-7b09f31309b4" released by "_delete_snapshot" :: held 2.131s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-6d545509-2269-46ba-af34-8f1e3ee4d418" released by "delete_snapshot" :: held 2.142s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:46 devstack cinder-volume[82546]: WARNING cinder.quota [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-551214661 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-551214661, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:16:46 devstack cinder-volume[82546]: WARNING cinder.quota [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-551214661 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-551214661, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Created reservations ['99e28b7f-fdee-4b52-a98e-a816227be84f', 'fd45a06d-5073-4e47-8640-436757e403c1', '6dcee32c-420c-4788-a1f0-a9e220e64163', 'eeb7d912-e12e-454f-9862-c808a48902ab'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:46 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 1G" returned: 0 in 0.648s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:46 devstack sudo[86833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 Apr 10 12:16:46 devstack sudo[86833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] Created reservations ['44da1e07-46e8-4901-8b97-5c1b6113c024', '41bfe9a9-0e71-4db7-8226-91bb2ab9fbcd', 'edbf8775-c024-4cca-be28-4a7f31afd572', '3dd268df-9eac-4dd1-b3ec-07fc0723675d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-18f3cd43-fc11-4f78-b63d-817e95ce575d tempest-GroupSnapshotsTest-365159363 None] group_snapshot 0e7bca5d-4b56-4a61-a7e0-e5f8e499716f: deleted successfully Apr 10 12:16:46 devstack sudo[86833]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6" returned: 0 in 0.444s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:46 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 is being set with open permissions: ugo+rw Apr 10 12:16:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:46 devstack sudo[86839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 Apr 10 12:16:46 devstack sudo[86839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:47 devstack sudo[86839]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6" returned: 0 in 0.408s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1150613448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=406a37cb-af7b-48ae-9640-588b2610dfe0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d23f1c15ad504f73a6d07461905bc7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:46Z,use_quota=True,user_id='2e49bbb768404eddb9e5012e328a8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Creating volume 406a37cb-af7b-48ae-9640-588b2610dfe0 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:47 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:47 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 1073741824 Apr 10 12:16:47 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b2a11359-f039-4150-9488-962158c5bb09 tempest-VolumesDeleteCascade-298236656 None] Create snapshot completed successfully Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-6d545509-2269-46ba-af34-8f1e3ee4d418" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-6d545509-2269-46ba-af34-8f1e3ee4d418" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[294f6478-6c59-46d3-a9de-6aec8fbe7ace]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:47 devstack sudo[86844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 Apr 10 12:16:47 devstack sudo[86844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:47 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 1073741824" returned: 0 in 0.529s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:47 devstack sudo[86849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 Apr 10 12:16:47 devstack sudo[86849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:47 devstack sudo[86844]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418" returned: 0 in 0.511s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:48 devstack sudo[86854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418 Apr 10 12:16:48 devstack sudo[86854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-68087231-1793-41c0-9a8f-037a450f3cb8-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-68087231-1793-41c0-9a8f-037a450f3cb8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:48 devstack sudo[86849]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0" returned: 0 in 0.465s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Performing cascade delete. {{(pid=82546) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-78dbbde6-bd18-4fb8-b7fc-10dd755389d4-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12254ec7-63cd-42ca-aa6d-cb9c3d9661d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-406a37cb-af7b-48ae-9640-588b2610dfe0', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2e56e4-5089-4891-8027-9499b154fb0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:48 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Volume volume-406a37cb-af7b-48ae-9640-588b2610dfe0 (406a37cb-af7b-48ae-9640-588b2610dfe0): created successfully Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d2e56e4-5089-4891-8027-9499b154fb0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Flow 'volume_create_manager' (3e329659-19fd-479d-a99d-d57501e20bcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-78dbbde6-bd18-4fb8-b7fc-10dd755389d4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:48 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f360c79a-8909-40e3-99a8-267a8303daae tempest-VolumesTestJSON-484360764 None] Created volume successfully. Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-78dbbde6-bd18-4fb8-b7fc-10dd755389d4" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-78dbbde6-bd18-4fb8-b7fc-10dd755389d4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Deleting offline snapshot 78dbbde6-bd18-4fb8-b7fc-10dd755389d4 of volume 68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] snapshot_file for this snap is: volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b82f0dd1-ba46-4da8-91bc-c064ac899b6e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:48 devstack sudo[86858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 Apr 10 12:16:48 devstack sudo[86858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:48 devstack sudo[86854]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6d545509-2269-46ba-af34-8f1e3ee4d418" returned: 0 in 0.476s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-6d545509-2269-46ba-af34-8f1e3ee4d418" released by "delete_volume" :: held 1.020s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-766e7f3e-26a9-4feb-ba97-12a39c961d34" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-766e7f3e-26a9-4feb-ba97-12a39c961d34" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1fe2df-cef1-4e7d-948d-08d66ab0c719]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:48 devstack sudo[86860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 Apr 10 12:16:48 devstack sudo[86860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:48 devstack sudo[86858]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4" returned: 0 in 0.525s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68087231-1793-41c0-9a8f-037a450f3cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe43e61-2cf1-4a22-9eba-9d94fed8f932]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:49 devstack sudo[86866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 Apr 10 12:16:49 devstack sudo[86866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:49 devstack sudo[86860]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Flow 'volume_create_manager' (d1a30f4d-0619-4a51-ad90-48f4bf6c8f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67c8ff2-f669-4942-a611-e3f572b9522c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34" returned: 0 in 0.562s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:49 devstack sudo[86870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34 Apr 10 12:16:49 devstack sudo[86870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a67c8ff2-f669-4942-a611-e3f572b9522c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-140786134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5198cc62-dbd1-4cc8-8d6d-ff585a486ba6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d23f1c15ad504f73a6d07461905bc7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:49Z,use_quota=True,user_id='2e49bbb768404eddb9e5012e328a8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff8b562-a608-401e-ad56-788e1aeba16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eff8b562-a608-401e-ad56-788e1aeba16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c43a883-a736-494c-88cb-fb725d848895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c43a883-a736-494c-88cb-fb725d848895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5198cc62-dbd1-4cc8-8d6d-ff585a486ba6', 'volume_name': 'volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82905b66-c23f-4ee6-82a2-b35530977012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82905b66-c23f-4ee6-82a2-b35530977012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b50eae-3d8c-410e-90d0-0d9889043e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:49 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Volume 5198cc62-dbd1-4cc8-8d6d-ff585a486ba6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6', 'volume_size': 1} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-140786134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5198cc62-dbd1-4cc8-8d6d-ff585a486ba6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d23f1c15ad504f73a6d07461905bc7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:49Z,use_quota=True,user_id='2e49bbb768404eddb9e5012e328a8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Creating volume 5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:49 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:49 devstack sudo[86872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 1073741824 Apr 10 12:16:49 devstack sudo[86872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:49 devstack sudo[86866]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8" returned: 0 in 0.508s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7ca5c7-c0a6-48cc-89fe-b880800faadc]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:49 devstack sudo[86870]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-766e7f3e-26a9-4feb-ba97-12a39c961d34" returned: 0 in 0.449s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-766e7f3e-26a9-4feb-ba97-12a39c961d34" released by "delete_volume" :: held 1.049s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:49 devstack sudo[86878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 Apr 10 12:16:49 devstack sudo[86878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Created reservations ['abffe109-69f9-4927-bbf2-899a3182df07'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:49 devstack cinder-volume[82546]: WARNING cinder.quota [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-551214661 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-551214661, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Created reservations ['a0acfbe6-1025-43e4-9e9f-a5f83588e7a6', '48df880f-2653-40a8-985e-b346356557d0', '18f2665e-5477-481c-a941-5f39bf623d08', '466b15d9-7e9f-4cbd-90ad-1866e9c0f8cf'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:49 devstack sudo[86872]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 1073741824" returned: 0 in 0.575s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Created reservations ['ee9a2aff-d4b5-48f5-a3db-6a6b30d62478', '871e1d38-1461-4d4b-939a-809e9a3b0d8e', '6baabb4b-920e-4fdf-872b-4a8fc6ffe7b3', '6018701b-6efe-4af0-a7c6-96fc15b2a613'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:49 devstack sudo[86883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 Apr 10 12:16:49 devstack sudo[86883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:49 devstack sudo[86885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:49 devstack sudo[86885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:49 devstack sudo[86878]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6" returned: 0 in 0.527s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68087231-1793-41c0-9a8f-037a450f3cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b778633-099b-410b-94f2-2dcdd4f79244]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:50 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 Apr 10 12:16:50 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:50 devstack sudo[86883]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6" returned: 0 in 0.434s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15b50eae-3d8c-410e-90d0-0d9889043e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba938bed-ee26-4622-a4de-2b1ed405b18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:50 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Volume volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 (5198cc62-dbd1-4cc8-8d6d-ff585a486ba6): created successfully Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba938bed-ee26-4622-a4de-2b1ed405b18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Flow 'volume_create_manager' (d1a30f4d-0619-4a51-ad90-48f4bf6c8f42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d2f44973-b815-4a0b-aed6-11e722c1924d tempest-VolumesTestJSON-484360764 None] Created volume successfully. Apr 10 12:16:50 devstack sudo[86885]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-450bcb0f-7a33-4d45-a0fe-ee693a4b0f2d tempest-GroupSnapshotsTest-365159363 None] Delete group completed successfully. Apr 10 12:16:50 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4" returned: 0 in 0.523s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68087231-1793-41c0-9a8f-037a450f3cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a059be49-ab3e-4c8a-ab61-5861fb7af32f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:50 devstack sudo[86931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 Apr 10 12:16:50 devstack sudo[86931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:51 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d21e22ae-f1f5-4973-bbe0-63d8bf51e508 tempest-GroupSnapshotsTest-365159363 None] Group tempest-GroupSnapshotsTest-Group-1271136899: creating Apr 10 12:16:51 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d21e22ae-f1f5-4973-bbe0-63d8bf51e508 tempest-GroupSnapshotsTest-365159363 None] Group tempest-GroupSnapshotsTest-Group-1271136899: created successfully Apr 10 12:16:51 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d21e22ae-f1f5-4973-bbe0-63d8bf51e508 tempest-GroupSnapshotsTest-365159363 None] Create group completed successfully. Apr 10 12:16:51 devstack sudo[86931]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8" returned: 0 in 0.699s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:51 devstack sudo[86937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 Apr 10 12:16:51 devstack sudo[86937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Flow 'volume_create_manager' (fadf62ca-055d-4475-9a66-78cdf26eacb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33e50fc-55b0-42cc-8284-5cf5e6a414f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b33e50fc-55b0-42cc-8284-5cf5e6a414f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2091513484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fbb958-5a17-4daf-8f6b-0df3e544b58a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d23f1c15ad504f73a6d07461905bc7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:51Z,use_quota=True,user_id='2e49bbb768404eddb9e5012e328a8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e06ec1-bb90-4a8b-9889-91fdb671c5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8e06ec1-bb90-4a8b-9889-91fdb671c5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca3ae90-5021-4fa6-b583-f896011ed4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ca3ae90-5021-4fa6-b583-f896011ed4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75fbb958-5a17-4daf-8f6b-0df3e544b58a', 'volume_name': 'volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c617fd-c094-4757-bcda-5bcda5d210b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c617fd-c094-4757-bcda-5bcda5d210b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca74fa7-f2fb-4fdd-aa8c-c8d0ef4c64c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:51 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Volume 75fbb958-5a17-4daf-8f6b-0df3e544b58a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a', 'volume_size': 1} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2091513484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75fbb958-5a17-4daf-8f6b-0df3e544b58a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d23f1c15ad504f73a6d07461905bc7b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:51Z,use_quota=True,user_id='2e49bbb768404eddb9e5012e328a8992',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Creating volume 75fbb958-5a17-4daf-8f6b-0df3e544b58a {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:51 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:51 devstack sudo[86940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a 1073741824 Apr 10 12:16:51 devstack sudo[86940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:51 devstack sudo[86937]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4" returned: 0 in 0.575s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:51 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4 Apr 10 12:16:51 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:52 devstack sudo[86940]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a 1073741824" returned: 0 in 0.587s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:52 devstack sudo[86950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a Apr 10 12:16:52 devstack sudo[86950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:52 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.78dbbde6-bd18-4fb8-b7fc-10dd755389d4" returned: 0 in 0.516s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 -F qcow2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:52 devstack sudo[86952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 -F qcow2 Apr 10 12:16:52 devstack sudo[86952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Flow 'volume_create_manager' (1a69529b-e033-4b7c-8477-de9dc3415085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0f83a6-37b5-4d28-80ab-c09aebe717c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f0f83a6-37b5-4d28-80ab-c09aebe717c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1355074128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8773bc0-6d2c-49fe-bd75-761af2f2e40a,host='devstack@QuobyteHD#QuobyteHD',id=697cb4b1-c662-4fc2-b963-d97d60e77167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853307c8a4744284a853616d0a1fe9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:52Z,use_quota=True,user_id='4070d4c57a25435aa94f1112e8798dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e0c5aec-0a01-45a9-b3f9-47b707a7ec55),volume_type_id=3e0c5aec-0a01-45a9-b3f9-47b707a7ec55)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e48eb0-47e1-4c8c-848f-3804d6ca9724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35e48eb0-47e1-4c8c-848f-3804d6ca9724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fb55bf-6d15-4931-89aa-947d5b78d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20fb55bf-6d15-4931-89aa-947d5b78d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '697cb4b1-c662-4fc2-b963-d97d60e77167', 'volume_name': 'volume-697cb4b1-c662-4fc2-b963-d97d60e77167', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37eab675-faba-4c94-96b4-200dbaba98ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37eab675-faba-4c94-96b4-200dbaba98ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e5d6a3-cec6-43fe-997c-1cd4d5a6ccb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:52 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Volume 697cb4b1-c662-4fc2-b963-d97d60e77167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-697cb4b1-c662-4fc2-b963-d97d60e77167', 'volume_size': 1} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:52 devstack sudo[86950]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a" returned: 0 in 0.541s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.269s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a8773bc0-6d2c-49fe-bd75-761af2f2e40a,created_at=2026-04-10T10:16:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1355074128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a8773bc0-6d2c-49fe-bd75-761af2f2e40a,host='devstack@QuobyteHD#QuobyteHD',id=697cb4b1-c662-4fc2-b963-d97d60e77167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='853307c8a4744284a853616d0a1fe9c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:52Z,use_quota=True,user_id='4070d4c57a25435aa94f1112e8798dc0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e0c5aec-0a01-45a9-b3f9-47b707a7ec55),volume_type_id=3e0c5aec-0a01-45a9-b3f9-47b707a7ec55)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Creating volume 697cb4b1-c662-4fc2-b963-d97d60e77167 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:52 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ca74fa7-f2fb-4fdd-aa8c-c8d0ef4c64c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:52 devstack sudo[86969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 1073741824 Apr 10 12:16:52 devstack sudo[86969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272f9f6d-0f02-465c-8cf8-40b4e8c82e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:52 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Volume volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a (75fbb958-5a17-4daf-8f6b-0df3e544b58a): created successfully Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272f9f6d-0f02-465c-8cf8-40b4e8c82e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:52 devstack sudo[86952]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Flow 'volume_create_manager' (fadf62ca-055d-4475-9a66-78cdf26eacb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68087231-1793-41c0-9a8f-037a450f3cb8 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 -F qcow2" returned: 0 in 0.534s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:52 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-27af3aba-b6a9-4868-906d-9ecee9b8b962 tempest-VolumesTestJSON-484360764 None] Created volume successfully. Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-78dbbde6-bd18-4fb8-b7fc-10dd755389d4" released by "_delete_snapshot" :: held 4.500s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" released by "delete_snapshot" :: held 4.523s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Created reservations ['446cfc46-3c2c-4b66-bf58-1df8e5454745', '325473ca-8d91-42db-8aa2-0216f7a5d903', 'b270f205-0d12-494a-b470-7f54509c1eb4', 'd73780ce-e0e8-487c-8544-c9f5aaa03b61'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:52 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Delete snapshot completed successfully. Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-78dbbde6-bd18-4fb8-b7fc-10dd755389d4-delete_snapshot" released by "delete_snapshot" :: held 4.639s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-f474b22e-7bc2-40ee-830d-7233374f81c6-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-f474b22e-7bc2-40ee-830d-7233374f81c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-f474b22e-7bc2-40ee-830d-7233374f81c6" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-f474b22e-7bc2-40ee-830d-7233374f81c6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Deleting offline snapshot f474b22e-7bc2-40ee-830d-7233374f81c6 of volume 68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] snapshot_file for this snap is: volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4678fe2f-8dc2-42f0-8632-17376e212b36]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:53 devstack sudo[86976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 Apr 10 12:16:53 devstack sudo[86976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:53 devstack sudo[86969]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 1073741824" returned: 0 in 0.555s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:53 devstack sudo[86981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 Apr 10 12:16:53 devstack sudo[86981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:53 devstack sudo[86976]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6" returned: 0 in 0.537s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68087231-1793-41c0-9a8f-037a450f3cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1eaf58-1a38-4f34-9bb6-82035369f093]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:53 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 Apr 10 12:16:53 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:53 devstack sudo[86981]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167" returned: 0 in 0.491s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04e5d6a3-cec6-43fe-997c-1cd4d5a6ccb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-697cb4b1-c662-4fc2-b963-d97d60e77167', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7e8828-871a-4ffc-8113-63f9e8bf40c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:53 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Volume volume-697cb4b1-c662-4fc2-b963-d97d60e77167 (697cb4b1-c662-4fc2-b963-d97d60e77167): created successfully Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b7e8828-871a-4ffc-8113-63f9e8bf40c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Flow 'volume_create_manager' (1a69529b-e033-4b7c-8477-de9dc3415085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:53 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-26d2e40c-48f7-40fe-b32d-49c7b5f0df30 tempest-GroupSnapshotsTest-365159363 None] Created volume successfully. Apr 10 12:16:54 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8" returned: 0 in 0.510s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:54 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 Apr 10 12:16:54 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Acquiring lock "cinder-75fbb958-5a17-4daf-8f6b-0df3e544b58a-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Lock "cinder-75fbb958-5a17-4daf-8f6b-0df3e544b58a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Acquiring lock "cinder-quobyte-75fbb958-5a17-4daf-8f6b-0df3e544b58a" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Lock "cinder-quobyte-75fbb958-5a17-4daf-8f6b-0df3e544b58a" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62b502b-2a2f-4042-a6d9-acabd455308f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:54 devstack sudo[86996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a Apr 10 12:16:54 devstack sudo[86996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:54 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:54 devstack sudo[87001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6 Apr 10 12:16:54 devstack sudo[87001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:54 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] GroupSnapshot deabeda4-f74c-4e8f-b632-1d7fa99b88aa: creating. Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Group snapshot deabeda4-f74c-4e8f-b632-1d7fa99b88aa: creating. {{(pid=82546) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Creating offline snapshot 07e007f4-cc71-4395-b0c9-bcc92c8e8c00 of volume 697cb4b1-c662-4fc2-b963-d97d60e77167 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[41348752-2800-4f6c-8569-bf60c6c8b336]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:54 devstack sudo[87006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 Apr 10 12:16:54 devstack sudo[87006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:54 devstack sudo[86996]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a" returned: 0 in 0.562s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:54 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a Apr 10 12:16:54 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:55 devstack sudo[87001]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8.f474b22e-7bc2-40ee-830d-7233374f81c6" returned: 0 in 0.452s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-f474b22e-7bc2-40ee-830d-7233374f81c6" released by "_delete_snapshot" :: held 2.054s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" released by "delete_snapshot" :: held 2.066s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Created reservations ['91410e54-77a3-49e6-bf35-2b6dc50b398a', 'e4991ff7-c82a-48c3-becf-d43eb075a190', '117cf4a4-8f5f-45ca-a084-dd2dccfa9fd9', '310a6f80-83f2-4b10-9e54-213cc072a197'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Delete snapshot completed successfully. Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-f474b22e-7bc2-40ee-830d-7233374f81c6-delete_snapshot" released by "delete_snapshot" :: held 2.164s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Snapshots deleted, issuing volume delete {{(pid=82546) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f7f8e4-748b-4959-8e2e-d5168dd616ae]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:55 devstack sudo[87011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 Apr 10 12:16:55 devstack sudo[87011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:55 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:55 devstack sudo[87006]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-75fbb958-5a17-4daf-8f6b-0df3e544b58a" returned: 0 in 0.439s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167" returned: 0 in 0.521s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Lock "cinder-quobyte-75fbb958-5a17-4daf-8f6b-0df3e544b58a" released by "delete_volume" :: held 1.035s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:55 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 1G Apr 10 12:16:55 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Created reservations ['943930d7-4b6e-4788-a3a2-3618576095d4', '1883a924-f0f1-4981-95ec-e04a4e2ed77b', 'c649f43d-3c18-4861-b558-aa321bd07e76', 'c24da649-764b-4874-b356-5c7a8414efbb'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:55 devstack sudo[87019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:55 devstack sudo[87019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:55 devstack sudo[87011]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8" returned: 0 in 0.559s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:55 devstack sudo[87027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8 Apr 10 12:16:55 devstack sudo[87027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:55 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 1G" returned: 0 in 0.569s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697cb4b1-c662-4fc2-b963-d97d60e77167 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:55 devstack sudo[87019]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Deleted volume successfully. Apr 10 12:16:55 devstack sudo[87033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697cb4b1-c662-4fc2-b963-d97d60e77167 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 Apr 10 12:16:55 devstack sudo[87033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-75c9fd26-1920-467a-ada4-8e6df33123b6 tempest-VolumesTestJSON-484360764 None] Lock "cinder-75fbb958-5a17-4daf-8f6b-0df3e544b58a-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:56 devstack sudo[87027]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-68087231-1793-41c0-9a8f-037a450f3cb8" returned: 0 in 0.445s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-68087231-1793-41c0-9a8f-037a450f3cb8" released by "delete_volume" :: held 1.032s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Created reservations ['198be75a-72cf-4732-ae4b-5079817cdd05', '8d301d46-2a6e-4e42-92da-1bf540854940', 'dc7a1953-ab7b-47ff-8046-b5a534ba299e', 'f0be2714-bf88-4041-91ff-ddf1cbec16d6'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:56 devstack sudo[87036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:56 devstack sudo[87036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:56 devstack sudo[87033]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-697cb4b1-c662-4fc2-b963-d97d60e77167 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00" returned: 0 in 0.456s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:56 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:56 devstack sudo[87041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 Apr 10 12:16:56 devstack sudo[87041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Acquiring lock "cinder-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Lock "cinder-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Acquiring lock "cinder-quobyte-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Lock "cinder-quobyte-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cdc438-aaad-483e-bacc-9a7bb807c05f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:56 devstack sudo[87043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 Apr 10 12:16:56 devstack sudo[87043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:56 devstack sudo[87036]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.462s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Deleted volume successfully. Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a988dc40-a718-4930-a03c-fc08f0d082d0 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-68087231-1793-41c0-9a8f-037a450f3cb8-delete_volume" released by "delete_volume" :: held 8.496s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:56 devstack sudo[87041]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00" returned: 0 in 0.473s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:56 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.info Apr 10 12:16:56 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:57 devstack sudo[87043]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6" returned: 0 in 0.612s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:57 devstack sudo[87069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6 Apr 10 12:16:57 devstack sudo[87069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Flow 'volume_create_manager' (60eb7412-ffcd-41ea-bf43-ba07a6cccccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af69099-41b0-4d39-9868-59975faede89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2af69099-41b0-4d39-9868-59975faede89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1105642331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b901bbb6-edd9-4b55-957c-e8467a2f5db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4958b7c3d34c5d9a1ce032708e2d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:57Z,use_quota=True,user_id='e0a573cb90a14e02802f847fa04fb651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614e97f6-1403-42a6-816d-f6eaf4aa9073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (614e97f6-1403-42a6-816d-f6eaf4aa9073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906d9f6c-6410-4a55-9505-a353ae18d0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (906d9f6c-6410-4a55-9505-a353ae18d0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b901bbb6-edd9-4b55-957c-e8467a2f5db5', 'volume_name': 'volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbb9356-f11a-4b38-9db8-3dda507cfe86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbb9356-f11a-4b38-9db8-3dda507cfe86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c7753-79a1-4c3f-b2e7-e0d6b3555358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:57 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Volume b901bbb6-edd9-4b55-957c-e8467a2f5db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5', 'volume_size': 1} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:57 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.info" returned: 0 in 0.585s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:57 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:57 devstack sudo[87081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.info Apr 10 12:16:57 devstack sudo[87081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:57 devstack sudo[87069]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6" returned: 0 in 0.592s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Lock "cinder-quobyte-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6" released by "delete_volume" :: held 1.241s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Created reservations ['aa2f6f8d-9a1d-4fc8-8a94-86d47417774a', 'c120f467-9ff4-4d2e-ac74-bb60c4175c72', '5acd1d4e-1356-4053-80b1-87f2204c8da1', 'f53557b1-6334-4def-adc5-336d667b102e'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:57 devstack sudo[87086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:16:57 devstack sudo[87086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:58 devstack sudo[87081]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.info" returned: 0 in 0.522s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.179s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.630s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1105642331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b901bbb6-edd9-4b55-957c-e8467a2f5db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4958b7c3d34c5d9a1ce032708e2d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:16:57Z,use_quota=True,user_id='e0a573cb90a14e02802f847fa04fb651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Creating volume b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:16:58 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:58 devstack sudo[87089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 1073741824 Apr 10 12:16:58 devstack sudo[87089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:58 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c99747ea-a761-414c-8075-bb2bb00fb9af tempest-GroupSnapshotsTest-365159363 None] group_snapshot deabeda4-f74c-4e8f-b632-1d7fa99b88aa: created successfully Apr 10 12:16:58 devstack sudo[87086]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.564s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:16:58 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Deleted volume successfully. Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-046be943-4e57-40a2-bec0-bf1ba08815ef tempest-VolumesTestJSON-484360764 None] Lock "cinder-5198cc62-dbd1-4cc8-8d6d-ff585a486ba6-delete_volume" released by "delete_volume" :: held 1.942s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:16:58 devstack sudo[87089]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 1073741824" returned: 0 in 0.528s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:58 devstack sudo[87095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 Apr 10 12:16:58 devstack sudo[87095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Acquiring lock "cinder-406a37cb-af7b-48ae-9640-588b2610dfe0-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Lock "cinder-406a37cb-af7b-48ae-9640-588b2610dfe0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Acquiring lock "cinder-quobyte-406a37cb-af7b-48ae-9640-588b2610dfe0" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Lock "cinder-quobyte-406a37cb-af7b-48ae-9640-588b2610dfe0" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f84c85a-1cfe-472b-836a-6b9d6baf8b6b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:58 devstack sudo[87097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 Apr 10 12:16:58 devstack sudo[87097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:59 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] group_snapshot deabeda4-f74c-4e8f-b632-1d7fa99b88aa: deleting Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] group_snapshot deabeda4-f74c-4e8f-b632-1d7fa99b88aa: deleting {{(pid=82546) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 12:16:59 devstack sudo[87095]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-697cb4b1-c662-4fc2-b963-d97d60e77167" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5" returned: 0 in 0.606s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-697cb4b1-c662-4fc2-b963-d97d60e77167" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-07e007f4-cc71-4395-b0c9-bcc92c8e8c00" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (366c7753-79a1-4c3f-b2e7-e0d6b3555358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa0939f-cc8e-4dd3-923d-e5f809207016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:16:59 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Volume volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 (b901bbb6-edd9-4b55-957c-e8467a2f5db5): created successfully Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fa0939f-cc8e-4dd3-923d-e5f809207016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Flow 'volume_create_manager' (60eb7412-ffcd-41ea-bf43-ba07a6cccccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-07e007f4-cc71-4395-b0c9-bcc92c8e8c00" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Deleting offline snapshot 07e007f4-cc71-4395-b0c9-bcc92c8e8c00 of volume 697cb4b1-c662-4fc2-b963-d97d60e77167 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] snapshot_file for this snap is: volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:16:59 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-dd10ff19-c50c-461f-9f0e-7849ebe7b382 tempest-VolumesDeleteCascade-298236656 None] Created volume successfully. Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f03d4e46-154f-4ca1-aa45-345f83410d0f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:59 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 Apr 10 12:16:59 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:59 devstack sudo[87097]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0" returned: 0 in 0.851s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:59 devstack sudo[87106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0 Apr 10 12:16:59 devstack sudo[87106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Creating offline snapshot d10451a6-97c7-405e-9816-e3504bafccc5 of volume b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1795524-c3c5-474f-b3cd-a4480e521629]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:16:59 devstack sudo[87108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 Apr 10 12:16:59 devstack sudo[87108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:16:59 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00" returned: 0 in 0.621s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-697cb4b1-c662-4fc2-b963-d97d60e77167(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[64c231f5-517b-4cef-ac22-cc58e02a380b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:16:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:00 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 Apr 10 12:17:00 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:00 devstack sudo[87106]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-406a37cb-af7b-48ae-9640-588b2610dfe0" returned: 0 in 0.513s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Lock "cinder-quobyte-406a37cb-af7b-48ae-9640-588b2610dfe0" released by "delete_volume" :: held 1.391s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Created reservations ['9c40bb23-2ed7-41fc-b96e-7f5bfb348bea', '1eb9d494-e5d7-4fcd-b2dd-268005915d57', 'ae0218bd-ece5-4a95-90c7-91ba7076ba25', '3883a5e5-ea32-4f2f-9d15-4cd3fba72df4'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:00 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:00 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:00 devstack sudo[87108]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5" returned: 0 in 0.629s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:00 devstack sudo[87121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 1G Apr 10 12:17:00 devstack sudo[87121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:00 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167" returned: 0 in 0.504s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:00 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 Apr 10 12:17:00 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:00 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.487s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Deleted volume successfully. Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cf18d302-f534-4939-af10-38edd5555927 tempest-VolumesTestJSON-484360764 None] Lock "cinder-406a37cb-af7b-48ae-9640-588b2610dfe0-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:00 devstack sudo[87121]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 1G" returned: 0 in 0.663s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:00 devstack sudo[87160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 Apr 10 12:17:00 devstack sudo[87160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:01 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00" returned: 0 in 0.584s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:01 devstack sudo[87162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00 Apr 10 12:17:01 devstack sudo[87162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:01 devstack sudo[87160]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:01 devstack sudo[87162]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167.07e007f4-cc71-4395-b0c9-bcc92c8e8c00" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5" returned: 0 in 0.577s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:01 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 is being set with open permissions: ugo+rw Apr 10 12:17:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-07e007f4-cc71-4395-b0c9-bcc92c8e8c00" released by "_delete_snapshot" :: held 2.306s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-697cb4b1-c662-4fc2-b963-d97d60e77167" released by "delete_snapshot" :: held 2.372s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:01 devstack sudo[87169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 Apr 10 12:17:01 devstack sudo[87169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:01 devstack cinder-volume[82546]: WARNING cinder.quota [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1535688990 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1535688990, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:17:01 devstack cinder-volume[82546]: WARNING cinder.quota [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1535688990 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1535688990, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:17:01 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] Created reservations ['6d5640d2-aa48-49e1-b817-42e9c2ec4847', 'f2c5a71f-bf22-4de9-8b1c-a7f2a184e76f', '9fc33d80-a529-4b21-a24c-7ddb006027e6', '5a45829a-0ddf-42b0-802e-fe5da09ce899'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:01 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-444e824b-86f9-4276-861f-ace537df0b14 tempest-GroupSnapshotsTest-365159363 None] group_snapshot deabeda4-f74c-4e8f-b632-1d7fa99b88aa: deleted successfully Apr 10 12:17:02 devstack sudo[87169]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:02 devstack sudo[87176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.info Apr 10 12:17:02 devstack sudo[87176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "cinder-quobyte-697cb4b1-c662-4fc2-b963-d97d60e77167" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-697cb4b1-c662-4fc2-b963-d97d60e77167" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:02 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[566d1ce9-a05b-486a-8240-c2f358d68aa1]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:02 devstack sudo[87176]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.info" returned: 0 in 0.526s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:02 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.info is being set with open permissions: ugo+rw Apr 10 12:17:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:02 devstack sudo[87181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.info Apr 10 12:17:02 devstack sudo[87181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:02 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 Apr 10 12:17:02 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:03 devstack sudo[87181]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.info" returned: 0 in 0.454s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.425s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:03 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3b6ed569-a8ae-42d1-bc56-92e75bc33a43 tempest-VolumesDeleteCascade-298236656 None] Create snapshot completed successfully Apr 10 12:17:03 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167" returned: 0 in 0.584s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:03 devstack sudo[87188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167 Apr 10 12:17:03 devstack sudo[87188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:03 devstack sudo[87188]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-697cb4b1-c662-4fc2-b963-d97d60e77167" returned: 0 in 0.431s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Lock "cinder-quobyte-697cb4b1-c662-4fc2-b963-d97d60e77167" released by "delete_volume" :: held 1.048s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Created reservations ['040d2646-c732-4740-a42e-c14ef074bd7f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:03 devstack cinder-volume[82546]: WARNING cinder.quota [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1535688990 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1535688990, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Created reservations ['14ee5ed1-98f7-45c8-bbfe-d35f59dfe85f', '53911a0b-6a1d-44d9-aedd-a966092a3512', 'a7df7bf5-60c7-4f0d-b7cb-1641126db4aa', '3a6cc596-317b-49dd-a0d5-d0035a0c9a7d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:03 devstack sudo[87191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:03 devstack sudo[87191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Flow 'volume_create_manager' (691a0022-e459-4f18-94f2-0ee662555bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b196b346-1e3e-4c90-9591-4375a2387dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b196b346-1e3e-4c90-9591-4375a2387dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1880429500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3852f2-ffe2-471b-a6d6-139e549e031c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b4958b7c3d34c5d9a1ce032708e2d7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d10451a6-97c7-405e-9816-e3504bafccc5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:04Z,use_quota=True,user_id='e0a573cb90a14e02802f847fa04fb651',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0165487-3286-4be8-9f97-a996fc442a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0165487-3286-4be8-9f97-a996fc442a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842d8147-fa4d-4e7b-8263-3851db24aed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (842d8147-fa4d-4e7b-8263-3851db24aed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'dd3852f2-ffe2-471b-a6d6-139e549e031c', 'volume_name': 'volume-dd3852f2-ffe2-471b-a6d6-139e549e031c', 'volume_size': 1, 'snapshot_id': 'd10451a6-97c7-405e-9816-e3504bafccc5'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d421828-fc0e-4404-b598-1be45194e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d421828-fc0e-4404-b598-1be45194e95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bbbd91-eb25-47fa-9e7b-a0a742c2cd50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:04 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Volume dd3852f2-ffe2-471b-a6d6-139e549e031c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-dd3852f2-ffe2-471b-a6d6-139e549e031c', 'volume_size': 1, 'snapshot_id': 'd10451a6-97c7-405e-9816-e3504bafccc5'} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-d10451a6-97c7-405e-9816-e3504bafccc5-dd3852f2-ffe2-471b-a6d6-139e549e031c" by "_create_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-d10451a6-97c7-405e-9816-e3504bafccc5-dd3852f2-ffe2-471b-a6d6-139e549e031c" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Creating volume dd3852f2-ffe2-471b-a6d6-139e549e031c from snapshot d10451a6-97c7-405e-9816-e3504bafccc5 {{(pid=82546) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-dd3852f2-ffe2-471b-a6d6-139e549e031c" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-dd3852f2-ffe2-471b-a6d6-139e549e031c" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] snapshot: d10451a6-97c7-405e-9816-e3504bafccc5, volume: dd3852f2-ffe2-471b-a6d6-139e549e031c, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:04 devstack sudo[87191]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.458s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[faef0ff1-c6fe-47c8-82f4-fe4b789c1912]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:04 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-54358cbb-ccf0-4e31-ae09-e746a5333f97 tempest-GroupSnapshotsTest-365159363 None] Delete group completed successfully. Apr 10 12:17:04 devstack sudo[87195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 Apr 10 12:17:04 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-deaa2acf-3d6b-4095-a7e5-707eb1de6824 tempest-BackendsCapabilitiesAdminTestsJSON-652198758 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82546) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 12:17:04 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b53425-9b2f-4306-86d3-6f6f977316f6]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:04 devstack sudo[87200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 Apr 10 12:17:04 devstack sudo[87200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ac4db3c-1e97-4ef8-9364-591dae4c5313 tempest-BackendsCapabilitiesAdminTestsJSON-652198758 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7580032348633, 'free_capacity_gb': 1775.7580032348633, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82546) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 10 12:17:05 devstack sudo[87200]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5" returned: 0 in 0.523s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:05 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:17:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:05 devstack sudo[87205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c Apr 10 12:17:05 devstack sudo[87205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:07 devstack sudo[87205]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c" returned: 0 in 2.692s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:07 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cbc5269-1a84-4165-b3bb-86242e5d6a6b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:07 devstack sudo[87217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 Apr 10 12:17:07 devstack sudo[87217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:08 devstack sudo[87217]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5" returned: 0 in 0.759s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:08 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5, size 1024.00 MB, duration 2.69 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:17:08 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Converted 1024.00 MB image at 380.19 MB/s Apr 10 12:17:08 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c is being set with open permissions: ugo+rw Apr 10 12:17:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:08 devstack sudo[87222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c Apr 10 12:17:08 devstack sudo[87222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:09 devstack sudo[87222]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c" returned: 0 in 0.450s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-dd3852f2-ffe2-471b-a6d6-139e549e031c" released by "_copy_volume_from_snapshot" :: held 4.998s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-d10451a6-97c7-405e-9816-e3504bafccc5-dd3852f2-ffe2-471b-a6d6-139e549e031c" released by "_create_volume_from_snapshot" :: held 5.016s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.027s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bbbd91-eb25-47fa-9e7b-a0a742c2cd50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3852f2-ffe2-471b-a6d6-139e549e031c', 'volume_size': 1, 'snapshot_id': 'd10451a6-97c7-405e-9816-e3504bafccc5'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f83e8a-63a9-47aa-9cf0-e7f7a5964041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:09 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Volume volume-dd3852f2-ffe2-471b-a6d6-139e549e031c (dd3852f2-ffe2-471b-a6d6-139e549e031c): created successfully Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f83e8a-63a9-47aa-9cf0-e7f7a5964041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Flow 'volume_create_manager' (691a0022-e459-4f18-94f2-0ee662555bd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:09 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ec4f19fe-5e1e-403a-9c38-a6d40cffe987 tempest-VolumesDeleteCascade-298236656 None] Created volume successfully. Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-b901bbb6-edd9-4b55-957c-e8467a2f5db5-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-b901bbb6-edd9-4b55-957c-e8467a2f5db5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Performing cascade delete. {{(pid=82546) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-d10451a6-97c7-405e-9816-e3504bafccc5-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-d10451a6-97c7-405e-9816-e3504bafccc5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-b901bbb6-edd9-4b55-957c-e8467a2f5db5" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-b901bbb6-edd9-4b55-957c-e8467a2f5db5" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-d10451a6-97c7-405e-9816-e3504bafccc5" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-d10451a6-97c7-405e-9816-e3504bafccc5" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Deleting offline snapshot d10451a6-97c7-405e-9816-e3504bafccc5 of volume b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] snapshot_file for this snap is: volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f95cb0d-e9e8-4a8b-95b4-559dd35f3917]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:09 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1146ebae-116c-4156-87fc-578a2e602a7a tempest-GroupsV314Test-1429362433 None] Group tempest-GroupsV314Test-Group-2010774944: creating Apr 10 12:17:09 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1146ebae-116c-4156-87fc-578a2e602a7a tempest-GroupsV314Test-1429362433 None] Group tempest-GroupsV314Test-Group-2010774944: created successfully Apr 10 12:17:09 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1146ebae-116c-4156-87fc-578a2e602a7a tempest-GroupsV314Test-1429362433 None] Create group completed successfully. Apr 10 12:17:09 devstack sudo[87227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 Apr 10 12:17:09 devstack sudo[87227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:10 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-76149620-6f53-40e9-8185-89b5a9562af1 tempest-GroupSnapshotsV319Test-1026824329 None] Group tempest-GroupSnapshotsV319Test-Group-1977817488: creating Apr 10 12:17:10 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-76149620-6f53-40e9-8185-89b5a9562af1 tempest-GroupSnapshotsV319Test-1026824329 None] Group tempest-GroupSnapshotsV319Test-Group-1977817488: created successfully Apr 10 12:17:10 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-76149620-6f53-40e9-8185-89b5a9562af1 tempest-GroupSnapshotsV319Test-1026824329 None] Create group completed successfully. Apr 10 12:17:10 devstack sudo[87227]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5" returned: 0 in 0.565s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:10 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee79804b-5c21-45a8-a928-24f435920be5]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:10 devstack sudo[87232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 Apr 10 12:17:10 devstack sudo[87232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:10 devstack sudo[87232]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5" returned: 0 in 0.543s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:11 devstack sudo[87237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 Apr 10 12:17:11 devstack sudo[87237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Flow 'volume_create_manager' (822e45a3-f0f6-4e49-8942-7556d69667fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1db7e9e-4fbc-4ab0-8665-97f60c6f333a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1db7e9e-4fbc-4ab0-8665-97f60c6f333a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1144936559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34e916eb-b146-43fa-ac7e-d892e8f635e0,host='devstack@QuobyteHD#QuobyteHD',id=57fef295-e010-47b9-9fc1-13a532a03d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='489352b44c7b4bb29c67c8989d52b6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:11Z,use_quota=True,user_id='16d56082cdcd4129ad3717f6bdfc6536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15e98342-14f0-4ebd-9bda-79d8de8d6c13),volume_type_id=15e98342-14f0-4ebd-9bda-79d8de8d6c13)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41af8c71-de5d-446e-86c0-a8fbf9420401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41af8c71-de5d-446e-86c0-a8fbf9420401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143343c5-9513-4696-a865-df500c32c9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (143343c5-9513-4696-a865-df500c32c9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57fef295-e010-47b9-9fc1-13a532a03d64', 'volume_name': 'volume-57fef295-e010-47b9-9fc1-13a532a03d64', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbbfae2-21ad-4947-a356-46a972cf5b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fbbfae2-21ad-4947-a356-46a972cf5b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde3e5ba-cbfc-4bda-af61-b703988ce304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Volume 57fef295-e010-47b9-9fc1-13a532a03d64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57fef295-e010-47b9-9fc1-13a532a03d64', 'volume_size': 1} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=34e916eb-b146-43fa-ac7e-d892e8f635e0,created_at=2026-04-10T10:17:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1144936559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=34e916eb-b146-43fa-ac7e-d892e8f635e0,host='devstack@QuobyteHD#QuobyteHD',id=57fef295-e010-47b9-9fc1-13a532a03d64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='489352b44c7b4bb29c67c8989d52b6df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:11Z,use_quota=True,user_id='16d56082cdcd4129ad3717f6bdfc6536',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(15e98342-14f0-4ebd-9bda-79d8de8d6c13),volume_type_id=15e98342-14f0-4ebd-9bda-79d8de8d6c13)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Creating volume 57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:11 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:11 devstack sudo[87239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 1073741824 Apr 10 12:17:11 devstack sudo[87239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:11 devstack sudo[87237]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5" returned: 0 in 0.575s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:11 devstack sudo[87244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5 Apr 10 12:17:11 devstack sudo[87244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Flow 'volume_create_manager' (497b1676-bb20-476c-a5ad-563330bd4fa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb94234e-0c93-4283-ad4a-f1c775c0c296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb94234e-0c93-4283-ad4a-f1c775c0c296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1404934922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=240a8ff1-11d7-4e1a-9c4b-a5f3a0b748cc,host='devstack@QuobyteHD#QuobyteHD',id=1f9fa982-cf78-4f3a-bc6d-f618cab0e254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5c447e9604449580f09fc9a49c84ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:12Z,use_quota=True,user_id='39d58de4ee2845c9928a8482bb44ea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a01e079-ca1c-436d-8b6a-5c16a2526fa5),volume_type_id=1a01e079-ca1c-436d-8b6a-5c16a2526fa5)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4cd8bc-5a4d-40dd-ab80-78bb86939ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c4cd8bc-5a4d-40dd-ab80-78bb86939ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05b7f11-890b-4895-9545-a6a6d852fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b05b7f11-890b-4895-9545-a6a6d852fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f9fa982-cf78-4f3a-bc6d-f618cab0e254', 'volume_name': 'volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa0928e-91a6-475f-b358-50133c66f4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baa0928e-91a6-475f-b358-50133c66f4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc77b7a-ebba-4ab5-8682-8c23f45e270c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:11 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Volume 1f9fa982-cf78-4f3a-bc6d-f618cab0e254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254', 'volume_size': 1} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:11 devstack sudo[87239]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 1073741824" returned: 0 in 0.669s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:11 devstack sudo[87250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 Apr 10 12:17:11 devstack sudo[87250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Acquiring lock "cinder-6a0aac31-8441-4138-b5c4-fc8d1fee730b-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Lock "cinder-6a0aac31-8441-4138-b5c4-fc8d1fee730b-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:12 devstack sudo[87244]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5.d10451a6-97c7-405e-9816-e3504bafccc5" returned: 0 in 0.513s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-d10451a6-97c7-405e-9816-e3504bafccc5" released by "_delete_snapshot" :: held 2.259s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-b901bbb6-edd9-4b55-957c-e8467a2f5db5" released by "delete_snapshot" :: held 2.278s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Acquiring lock "cinder-quobyte-6a0aac31-8441-4138-b5c4-fc8d1fee730b" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Lock "cinder-quobyte-6a0aac31-8441-4138-b5c4-fc8d1fee730b" acquired by "delete_volume" :: waited 0.019s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3818d5d1-53d3-4346-a5a9-c00eab522d2b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Created reservations ['3d4b1c66-e758-4787-8d2c-ce48056e3ae5', '82dabdc9-f2b5-45a0-9c1d-0cafeadac363', 'ef0f3b47-b93b-469e-9fec-ef9b61fd8729', '6e69206f-f3a3-4f6c-b89f-71ea89f9a1be'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:12 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Delete snapshot completed successfully. Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-d10451a6-97c7-405e-9816-e3504bafccc5-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Snapshots deleted, issuing volume delete {{(pid=82546) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-b901bbb6-edd9-4b55-957c-e8467a2f5db5" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-b901bbb6-edd9-4b55-957c-e8467a2f5db5" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:12 devstack sudo[87252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b Apr 10 12:17:12 devstack sudo[87252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac48645-6d56-43dd-8d0b-fedcd9707690]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:12 devstack sudo[87254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 Apr 10 12:17:12 devstack sudo[87254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:12 devstack sudo[87250]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64" returned: 0 in 0.450s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.526s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=240a8ff1-11d7-4e1a-9c4b-a5f3a0b748cc,created_at=2026-04-10T10:17:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1404934922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=240a8ff1-11d7-4e1a-9c4b-a5f3a0b748cc,host='devstack@QuobyteHD#QuobyteHD',id=1f9fa982-cf78-4f3a-bc6d-f618cab0e254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5c447e9604449580f09fc9a49c84ee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:12Z,use_quota=True,user_id='39d58de4ee2845c9928a8482bb44ea5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a01e079-ca1c-436d-8b6a-5c16a2526fa5),volume_type_id=1a01e079-ca1c-436d-8b6a-5c16a2526fa5)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Creating volume 1f9fa982-cf78-4f3a-bc6d-f618cab0e254 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:12 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde3e5ba-cbfc-4bda-af61-b703988ce304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57fef295-e010-47b9-9fc1-13a532a03d64', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3132c59f-ce1f-42b9-abf3-11988d6e9ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:12 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 1073741824 Apr 10 12:17:12 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:12 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Volume volume-57fef295-e010-47b9-9fc1-13a532a03d64 (57fef295-e010-47b9-9fc1-13a532a03d64): created successfully Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3132c59f-ce1f-42b9-abf3-11988d6e9ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Flow 'volume_create_manager' (822e45a3-f0f6-4e49-8942-7556d69667fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:12 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f955c5a5-5fee-4d9d-bed0-57745ff45926 tempest-GroupsV314Test-1429362433 None] Created volume successfully. Apr 10 12:17:12 devstack sudo[87252]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:12 devstack sudo[87264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b Apr 10 12:17:12 devstack sudo[87264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:12 devstack sudo[87254]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5" returned: 0 in 0.492s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:12 devstack sudo[87267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5 Apr 10 12:17:12 devstack sudo[87267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:12 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 1073741824" returned: 0 in 0.482s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:12 devstack sudo[87272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 Apr 10 12:17:12 devstack sudo[87272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:13 devstack sudo[87264]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6a0aac31-8441-4138-b5c4-fc8d1fee730b" returned: 0 in 0.454s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Lock "cinder-quobyte-6a0aac31-8441-4138-b5c4-fc8d1fee730b" released by "delete_volume" :: held 0.983s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Created reservations ['1e1c28cb-b037-4957-9c41-3f2363634b25', 'd5c77790-686e-4854-bd7c-bb640a929996', '3bf184c9-f4c2-4174-a235-c1b447ef6fda', '864e404b-f250-4c3d-8c40-dc9a63f30931'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:13 devstack sudo[87267]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b901bbb6-edd9-4b55-957c-e8467a2f5db5" returned: 0 in 0.460s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-b901bbb6-edd9-4b55-957c-e8467a2f5db5" released by "delete_volume" :: held 0.993s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:13 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:13 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Created reservations ['85bf4ca6-0638-4807-9000-b7a075bfd7b4', '25cc4562-d50c-45d4-9df4-df64337919a6', '80f72d6c-2963-466e-9e14-d2bfbc0fa806', '5c42c5f7-2982-416a-b082-dba9d97b45eb'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:13 devstack sudo[87278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:13 devstack sudo[87278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:13 devstack sudo[87272]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" returned: 0 in 0.457s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adc77b7a-ebba-4ab5-8682-8c23f45e270c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629c21fa-e869-4e8c-86b9-dd3a6d18b9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:13 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Volume volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 (1f9fa982-cf78-4f3a-bc6d-f618cab0e254): created successfully Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (629c21fa-e869-4e8c-86b9-dd3a6d18b9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Flow 'volume_create_manager' (497b1676-bb20-476c-a5ad-563330bd4fa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:13 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-5e941754-a247-4845-a535-71b58e839ef8 tempest-GroupSnapshotsV319Test-1026824329 None] Created volume successfully. Apr 10 12:17:13 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.468s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:13 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Deleted volume successfully. Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-521761da-79de-4fff-8374-c9905a56f805 tempest-VolumesNegativeTest-2033599011 None] Lock "cinder-6a0aac31-8441-4138-b5c4-fc8d1fee730b-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:13 devstack sudo[87278]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.401s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:13 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Deleted volume successfully. Apr 10 12:17:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f2ebaef7-38b2-4dd3-8998-c62622ee2347 tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-b901bbb6-edd9-4b55-957c-e8467a2f5db5-delete_volume" released by "delete_volume" :: held 3.998s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:14 devstack sudo[87284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:14 devstack sudo[87284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:14 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] GroupSnapshot e4d69711-f85f-462e-ba09-51541d8d1e3c: creating. Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Group snapshot e4d69711-f85f-462e-ba09-51541d8d1e3c: creating. {{(pid=82546) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Creating offline snapshot fcc97b65-6983-4272-b4e1-1e2c55a2fad2 of volume 1f9fa982-cf78-4f3a-bc6d-f618cab0e254 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec4bbbe-27a7-498d-b924-dbc291c40dab]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:14 devstack sudo[87286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 Apr 10 12:17:14 devstack sudo[87286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-dd3852f2-ffe2-471b-a6d6-139e549e031c-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-dd3852f2-ffe2-471b-a6d6-139e549e031c-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "cinder-quobyte-dd3852f2-ffe2-471b-a6d6-139e549e031c" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-dd3852f2-ffe2-471b-a6d6-139e549e031c" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58743cb-82b5-4c91-95e9-b5ec454187c7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:14 devstack sudo[87288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c Apr 10 12:17:14 devstack sudo[87288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:14 devstack sudo[87284]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.527s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:14 devstack sudo[87286]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" returned: 0 in 0.604s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:14 devstack sudo[87294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 1G Apr 10 12:17:14 devstack sudo[87294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:14 devstack sudo[87288]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c" returned: 0 in 0.586s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:14 devstack sudo[87299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c Apr 10 12:17:14 devstack sudo[87299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:15 devstack sudo[87294]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 1G" returned: 0 in 0.548s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:15 devstack sudo[87305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 Apr 10 12:17:15 devstack sudo[87305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:15 devstack sudo[87299]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-dd3852f2-ffe2-471b-a6d6-139e549e031c" returned: 0 in 0.487s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-quobyte-dd3852f2-ffe2-471b-a6d6-139e549e031c" released by "delete_volume" :: held 1.104s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Created reservations ['9d951d5e-cc1a-415c-b15d-6a5c7ddf0589', 'f40cd0e0-a477-4d95-a681-08295bebfb8a', '5130e4f3-c639-469c-9d4b-287b05451a5d', '8c3812a2-0f07-43f1-acd3-7d999d04a9f2'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:15 devstack sudo[87307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:15 devstack sudo[87307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:15 devstack sudo[87305]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2" returned: 0 in 0.441s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:15 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:17:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:15 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 Apr 10 12:17:15 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:16 devstack sudo[87307]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:16 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Deleted volume successfully. Apr 10 12:17:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-190d0fd0-dd48-4fd4-9b60-07baa5c65f2c tempest-VolumesDeleteCascade-298236656 None] Lock "cinder-dd3852f2-ffe2-471b-a6d6-139e549e031c-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:16 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2" returned: 0 in 0.542s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:16 devstack sudo[87316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.info Apr 10 12:17:16 devstack sudo[87316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:16 devstack sudo[87316]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.info" returned: 0 in 0.463s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:16 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:17:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:16 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.info Apr 10 12:17:16 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:17 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.info" returned: 0 in 0.568s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.234s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.180s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:17 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Cloning volume 57fef295-e010-47b9-9fc1-13a532a03d64 to volume 7dd8e0aa-c150-4549-ba4f-368ba8b46476 Apr 10 12:17:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Creating offline snapshot 64ed770d-8f89-4708-8cc6-11f22669f572 of volume 57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:17:17 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0062f38c-7709-4dcf-9b67-34da15a93310]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:17 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9d9ef48b-a20e-477d-b3cc-833339cfaf1a tempest-GroupSnapshotsV319Test-1026824329 None] group_snapshot e4d69711-f85f-462e-ba09-51541d8d1e3c: created successfully Apr 10 12:17:17 devstack sudo[87322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 Apr 10 12:17:17 devstack sudo[87322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:18 devstack sudo[87322]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64" returned: 0 in 0.600s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:18 devstack sudo[87327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 1G Apr 10 12:17:18 devstack sudo[87327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:18 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] group_snapshot e4d69711-f85f-462e-ba09-51541d8d1e3c: deleting Apr 10 12:17:18 devstack sudo[87327]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 1G" returned: 0 in 0.596s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57fef295-e010-47b9-9fc1-13a532a03d64 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:18 devstack sudo[87332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57fef295-e010-47b9-9fc1-13a532a03d64 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 Apr 10 12:17:18 devstack sudo[87332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] group_snapshot e4d69711-f85f-462e-ba09-51541d8d1e3c: deleting {{(pid=82546) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Acquiring lock "cinder-quobyte-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "cinder-quobyte-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Acquiring lock "cinder-quobyte-fcc97b65-6983-4272-b4e1-1e2c55a2fad2" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "cinder-quobyte-fcc97b65-6983-4272-b4e1-1e2c55a2fad2" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Deleting offline snapshot fcc97b65-6983-4272-b4e1-1e2c55a2fad2 of volume 1f9fa982-cf78-4f3a-bc6d-f618cab0e254 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] snapshot_file for this snap is: volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9e3471-5397-4cad-9e52-08c09cab1e51]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:19 devstack sudo[87334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 Apr 10 12:17:19 devstack sudo[87334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:19 devstack sudo[87332]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57fef295-e010-47b9-9fc1-13a532a03d64 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572" returned: 0 in 0.706s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:19 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:19 devstack sudo[87339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 Apr 10 12:17:19 devstack sudo[87339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Flow 'volume_create_manager' (7c3caff0-67c2-4e8d-bc30-e90180229ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b303198-4472-4481-a762-98afcb7eda94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b303198-4472-4481-a762-98afcb7eda94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1926642801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf196469-8ae3-4cfc-87ee-ff5020b5dd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65174969c1ad4599a282b109f19be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:19Z,use_quota=True,user_id='9ad491e4d16946939d76c253f03c1001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccadf47d-2cfa-4ee9-824c-e36f03688e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccadf47d-2cfa-4ee9-824c-e36f03688e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e8b8aa-3910-4a7c-9277-b49687e3f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8e8b8aa-3910-4a7c-9277-b49687e3f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf196469-8ae3-4cfc-87ee-ff5020b5dd97', 'volume_name': 'volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c72688c-79f6-4010-9bc2-fd99443db270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c72688c-79f6-4010-9bc2-fd99443db270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb869a61-1455-4bfe-85f1-427dc9d74a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:19 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Volume bf196469-8ae3-4cfc-87ee-ff5020b5dd97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97', 'volume_size': 1} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:19 devstack sudo[87334]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2" returned: 0 in 0.712s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd27338-b97c-4c3a-82d8-3344e27d221d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:19 devstack sudo[87346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 Apr 10 12:17:19 devstack sudo[87346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:19 devstack sudo[87339]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572" returned: 0 in 0.504s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:19 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.info Apr 10 12:17:19 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:20 devstack sudo[87346]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" returned: 0 in 0.541s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:20 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 Apr 10 12:17:20 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:20 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.info" returned: 0 in 0.478s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:20 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.info is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:20 devstack sudo[87357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.info Apr 10 12:17:20 devstack sudo[87357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:20 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2" returned: 0 in 0.489s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:20 devstack sudo[87362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2 Apr 10 12:17:20 devstack sudo[87362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:20 devstack sudo[87357]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.info" returned: 0 in 0.474s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Acquiring lock "cinder-quobyte-7dd8e0aa-c150-4549-ba4f-368ba8b46476" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Lock "cinder-quobyte-7dd8e0aa-c150-4549-ba4f-368ba8b46476" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] snapshot: 64ed770d-8f89-4708-8cc6-11f22669f572, volume: 7dd8e0aa-c150-4549-ba4f-368ba8b46476, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[04058eff-cd84-4d46-9e0e-46677d82c837]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:20 devstack sudo[87365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 Apr 10 12:17:20 devstack sudo[87365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:21 devstack sudo[87362]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254.fcc97b65-6983-4272-b4e1-1e2c55a2fad2" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "cinder-quobyte-fcc97b65-6983-4272-b4e1-1e2c55a2fad2" released by "_delete_snapshot" :: held 2.321s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "cinder-quobyte-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" released by "delete_snapshot" :: held 2.345s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:21 devstack cinder-volume[82546]: WARNING cinder.quota [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1250330842 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1250330842, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:17:21 devstack cinder-volume[82546]: WARNING cinder.quota [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1250330842 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1250330842, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] Created reservations ['f2c1b17f-5afc-4c94-abc4-e53284f20022', '7a4e8355-2ff9-44fd-a307-da6756fffeaf', '07c122de-4293-4b13-bb41-4bdf4b30b78b', '3d7817a6-6f43-4c3c-8db3-f28483e28a61'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-25586d11-0e7e-4612-b574-6a4e1d0aff58 tempest-GroupSnapshotsV319Test-1026824329 None] group_snapshot e4d69711-f85f-462e-ba09-51541d8d1e3c: deleted successfully Apr 10 12:17:21 devstack sudo[87365]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572" returned: 0 in 0.532s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57fef295-e010-47b9-9fc1-13a532a03d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d476a36-a384-4e99-9e0b-e8071966e49d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:21 devstack sudo[87371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 Apr 10 12:17:21 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:21 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64" returned: 0 in 0.507s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:17:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:21 devstack sudo[87376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 Apr 10 12:17:21 devstack sudo[87376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Acquiring lock "cinder-quobyte-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "cinder-quobyte-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" acquired by "delete_volume" :: waited 0.028s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:22 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[895f6d82-9aab-4490-ab8e-b166dec8cd2a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:22 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 Apr 10 12:17:22 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:23 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" returned: 0 in 1.064s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:23 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254 Apr 10 12:17:23 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:24 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" returned: 0 in 1.184s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "cinder-quobyte-1f9fa982-cf78-4f3a-bc6d-f618cab0e254" released by "delete_volume" :: held 2.285s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Created reservations ['bbafbdfa-e093-4b32-85cb-17147eb8255a'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:24 devstack cinder-volume[82546]: WARNING cinder.quota [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1250330842 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1250330842, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:17:24 devstack sudo[87376]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476" returned: 0 in 2.582s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Created reservations ['ead7621e-fae5-4f2f-91e0-c90a8233dbaa', 'eea32b4c-63cd-4a14-b822-648962a5f7ea', '3a3036b5-98f7-4949-9154-e7ffd9d79ea2', 'e4f32be0-9368-40d4-85e2-35ba765510db'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f05bf7e-8094-4e68-9c6d-8c70d1d1804e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:24 devstack sudo[87399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 Apr 10 12:17:24 devstack sudo[87399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:24 devstack sudo[87401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:24 devstack sudo[87401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:25 devstack sudo[87401]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.502s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:25 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ca06e4f6-c2bf-4183-909c-632fb3c9b699 tempest-GroupSnapshotsV319Test-1026824329 None] Delete group completed successfully. Apr 10 12:17:25 devstack sudo[87399]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64" returned: 0 in 0.770s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:17:25 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Converted 1024.00 MB image at 396.32 MB/s Apr 10 12:17:25 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 is being set with open permissions: ugo+rw: NotImplementedError Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:25 devstack sudo[87407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 Apr 10 12:17:25 devstack sudo[87407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (49bde85c-4faa-4452-9206-efa323671584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb4a633-7792-441f-8070-e36688ed1219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fb4a633-7792-441f-8070-e36688ed1219) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1963948299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f51579-f6d8-486f-afb4-c8538f2444e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225ff110b6e4bf7b6e4d69d9ff1fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:26Z,use_quota=True,user_id='88261f08fd504c15b73f3acbe4a44200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b0180c-b985-4485-98dd-ac50f58a6837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94b0180c-b985-4485-98dd-ac50f58a6837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a835bb31-c8de-4cc6-a932-aeeaa42db4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a835bb31-c8de-4cc6-a932-aeeaa42db4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f51579-f6d8-486f-afb4-c8538f2444e2', 'volume_name': 'volume-c0f51579-f6d8-486f-afb4-c8538f2444e2', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ced0044-b376-4c67-a999-0843ccaa6510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ced0044-b376-4c67-a999-0843ccaa6510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0ebf36-a59a-43d1-aa6d-e426cb6d0e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:25 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Volume c0f51579-f6d8-486f-afb4-c8538f2444e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f51579-f6d8-486f-afb4-c8538f2444e2', 'volume_size': 1} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:25 devstack sudo[87407]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476" returned: 0 in 0.452s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Lock "cinder-quobyte-7dd8e0aa-c150-4549-ba4f-368ba8b46476" released by "_copy_volume_from_snapshot" :: held 4.903s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Acquiring lock "cinder-quobyte-64ed770d-8f89-4708-8cc6-11f22669f572" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Lock "cinder-quobyte-64ed770d-8f89-4708-8cc6-11f22669f572" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Deleting offline snapshot 64ed770d-8f89-4708-8cc6-11f22669f572 of volume 57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] snapshot_file for this snap is: volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28ab0f0-8623-4af7-ba0c-105b3625b2d0]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:25 devstack sudo[87410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 Apr 10 12:17:25 devstack sudo[87410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:26 devstack sudo[87410]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572" returned: 0 in 0.546s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57fef295-e010-47b9-9fc1-13a532a03d64(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:26 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2612b44a-16cd-444c-8252-d10f08052b33]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:26 devstack sudo[87415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 Apr 10 12:17:26 devstack sudo[87415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:26 devstack sudo[87415]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64" returned: 0 in 0.523s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:26 devstack sudo[87420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 Apr 10 12:17:26 devstack sudo[87420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:27 devstack sudo[87420]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572" returned: 0 in 0.510s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:27 devstack sudo[87425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572 Apr 10 12:17:27 devstack sudo[87425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:27 devstack sudo[87425]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64.64ed770d-8f89-4708-8cc6-11f22669f572" returned: 0 in 0.501s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Lock "cinder-quobyte-64ed770d-8f89-4708-8cc6-11f22669f572" released by "_delete_snapshot" :: held 2.153s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.568s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.400s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1926642801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf196469-8ae3-4cfc-87ee-ff5020b5dd97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65174969c1ad4599a282b109f19be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:19Z,use_quota=True,user_id='9ad491e4d16946939d76c253f03c1001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Creating volume bf196469-8ae3-4cfc-87ee-ff5020b5dd97 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:27 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:27 devstack sudo[87428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 1073741824 Apr 10 12:17:27 devstack sudo[87428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a14ebc95-f596-4380-bc0d-e6b593d53a26 tempest-GroupsV314Test-1429362433 None] Create group from source-group-34e916eb-b146-43fa-ac7e-d892e8f635e0 completed successfully. Apr 10 12:17:28 devstack sudo[87428]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 1073741824" returned: 0 in 0.532s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:28 devstack sudo[87433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 Apr 10 12:17:28 devstack sudo[87433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Flow 'volume_create_manager' (c380424e-b589-4f86-8238-d27d5bc831a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f3d47c-5351-464a-9f9d-8a9fc7886023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14f3d47c-5351-464a-9f9d-8a9fc7886023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1242660983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a2831d-ea8a-47ab-9b64-34e9c8241066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19486a7ce73045ffa08dc05d8162d1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:29Z,use_quota=True,user_id='2f9acb45b91b408b9a22e6e9a50d5981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b848d9-b347-4497-935b-443840af64b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1b848d9-b347-4497-935b-443840af64b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddffb587-c568-4083-a27e-5196acf57c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddffb587-c568-4083-a27e-5196acf57c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a2831d-ea8a-47ab-9b64-34e9c8241066', 'volume_name': 'volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0a63cb-84f9-4ee4-93e8-c59baa8f987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0a63cb-84f9-4ee4-93e8-c59baa8f987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea6f584-07ed-4590-b3e9-26e2fc59b987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:28 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Volume f1a2831d-ea8a-47ab-9b64-34e9c8241066: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066', 'volume_size': 1} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Acquiring lock "cinder-quobyte-7dd8e0aa-c150-4549-ba4f-368ba8b46476" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Lock "cinder-quobyte-7dd8e0aa-c150-4549-ba4f-368ba8b46476" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab63b24a-0502-4550-96c2-dc00c02b890c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:28 devstack sudo[87435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 Apr 10 12:17:28 devstack sudo[87435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:28 devstack sudo[87433]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97" returned: 0 in 0.491s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.357s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1963948299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f51579-f6d8-486f-afb4-c8538f2444e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225ff110b6e4bf7b6e4d69d9ff1fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:26Z,use_quota=True,user_id='88261f08fd504c15b73f3acbe4a44200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Creating volume c0f51579-f6d8-486f-afb4-c8538f2444e2 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:29 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb869a61-1455-4bfe-85f1-427dc9d74a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f434d594-28d7-424b-800a-11dca035d74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:29 devstack sudo[87438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 1073741824 Apr 10 12:17:29 devstack sudo[87438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:29 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Volume volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 (bf196469-8ae3-4cfc-87ee-ff5020b5dd97): created successfully Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f434d594-28d7-424b-800a-11dca035d74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Flow 'volume_create_manager' (7c3caff0-67c2-4e8d-bc30-e90180229ab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:29 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b8826390-346a-4497-9b35-7631211bc8bd tempest-VolumesTransfersTest-2079135555 None] Created volume successfully. Apr 10 12:17:29 devstack sudo[87435]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476" returned: 0 in 0.512s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:29 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476 Apr 10 12:17:29 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:29 devstack sudo[87438]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 1073741824" returned: 0 in 0.526s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:29 devstack sudo[87448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 Apr 10 12:17:29 devstack sudo[87448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:29 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c03f9b82-fb71-48d2-8c32-31aa700d75af tempest-VolumesTransfersTest-1267726152 None] Transfer volume completed successfully. Apr 10 12:17:29 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7dd8e0aa-c150-4549-ba4f-368ba8b46476" returned: 0 in 0.439s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Lock "cinder-quobyte-7dd8e0aa-c150-4549-ba4f-368ba8b46476" released by "delete_volume" :: held 0.973s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Created reservations ['1604c9a4-1a92-464a-a714-3a29533399b1'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:29 devstack cinder-volume[82546]: WARNING cinder.quota [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1673531994 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1673531994, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:17:29 devstack cinder-volume[82546]: WARNING cinder.quota [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1673531994 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1673531994, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Created reservations ['c8dc8c1d-554b-4301-ac3f-d553d34bd631', '2fb169b4-dac3-4379-bbb4-ddbcbbcc74b4', '5a8feb1f-9faf-4643-b3ac-cc1015c7e092', '00e1c288-609d-4bce-85c2-016cd0eca18b'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:29 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:29 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:30 devstack sudo[87448]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2" returned: 0 in 0.459s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.343s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1242660983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a2831d-ea8a-47ab-9b64-34e9c8241066,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19486a7ce73045ffa08dc05d8162d1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:29Z,use_quota=True,user_id='2f9acb45b91b408b9a22e6e9a50d5981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Creating volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:30 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a0ebf36-a59a-43d1-aa6d-e426cb6d0e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f51579-f6d8-486f-afb4-c8538f2444e2', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a497007-cbd4-4d54-b5bb-3ad1d1ae6247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:30 devstack sudo[87454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 1073741824 Apr 10 12:17:30 devstack sudo[87454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:30 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Volume volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 (c0f51579-f6d8-486f-afb4-c8538f2444e2): created successfully Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a497007-cbd4-4d54-b5bb-3ad1d1ae6247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (49bde85c-4faa-4452-9206-efa323671584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:30 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-8a6023cc-9f8b-4cd5-9fb4-24103c70594b tempest-VolumesSnapshotTestJSON-2113475617 None] Created volume successfully. Apr 10 12:17:30 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Acquiring lock "cinder-bf196469-8ae3-4cfc-87ee-ff5020b5dd97-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:30 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-aff30cd4-652b-4015-989f-2bc119390037 tempest-GroupsV314Test-1429362433 None] Delete group completed successfully. Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Lock "cinder-bf196469-8ae3-4cfc-87ee-ff5020b5dd97-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Acquiring lock "cinder-quobyte-bf196469-8ae3-4cfc-87ee-ff5020b5dd97" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Lock "cinder-quobyte-bf196469-8ae3-4cfc-87ee-ff5020b5dd97" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[13503b1b-b0ed-4f76-9fde-27a399f9031e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:30 devstack sudo[87454]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 1073741824" returned: 0 in 0.532s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:30 devstack sudo[87460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 Apr 10 12:17:30 devstack sudo[87460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:30 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 Apr 10 12:17:30 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:31 devstack sudo[87460]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97" returned: 0 in 0.525s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:31 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97 Apr 10 12:17:31 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:31 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066" returned: 0 in 0.524s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.058s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aea6f584-07ed-4590-b3e9-26e2fc59b987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc66783d-35cd-47ee-a69b-a604be62f27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Acquiring lock "cinder-quobyte-57fef295-e010-47b9-9fc1-13a532a03d64" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:31 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Volume volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 (f1a2831d-ea8a-47ab-9b64-34e9c8241066): created successfully Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc66783d-35cd-47ee-a69b-a604be62f27b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Flow 'volume_create_manager' (c380424e-b589-4f86-8238-d27d5bc831a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Creating offline snapshot 78fc1c61-fc95-4351-9a26-780a216ee3e6 of volume c0f51579-f6d8-486f-afb4-c8538f2444e2 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:17:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-96ae9249-77e6-41f4-9efe-4cd931bff11e tempest-SnapshotsActionsTest-924362449 None] Created volume successfully. Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab6f0cc-914c-406a-b801-fbfadeba706d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Lock "cinder-quobyte-57fef295-e010-47b9-9fc1-13a532a03d64" acquired by "delete_volume" :: waited 0.051s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c26796-c167-42c3-bf45-11e1a6a064d0]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:31 devstack sudo[87470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 Apr 10 12:17:31 devstack sudo[87470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:31 devstack sudo[87471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 Apr 10 12:17:31 devstack sudo[87471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:31 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-bf196469-8ae3-4cfc-87ee-ff5020b5dd97" returned: 0 in 0.452s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Lock "cinder-quobyte-bf196469-8ae3-4cfc-87ee-ff5020b5dd97" released by "delete_volume" :: held 1.002s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Created reservations ['bbd59cd3-89cc-4bd9-9a4b-aa9344ea3b13', '55bf2aad-4c94-4f74-9abb-34d7f8d7e193', 'a841fc34-6122-4151-8ba6-1232e420de0a', '4a78abb0-218e-49a1-a2bf-4c483fbb670c'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=195,cinder:UPDATE=235,cinder:INSERT=67,cinder:DELETE=17 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:31 devstack sudo[87475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:31 devstack sudo[87475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:31 devstack sudo[87470]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2" returned: 0 in 0.520s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:31 devstack sudo[87483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 1G Apr 10 12:17:31 devstack sudo[87483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:31 devstack sudo[87471]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64" returned: 0 in 0.516s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:31 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64 Apr 10 12:17:31 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=222,cinder:INSERT=50,cinder:UPDATE=245,cinder:DELETE=10 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:17:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:32 devstack sudo[87475]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.449s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:32 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Deleted volume successfully. Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1e3be8f1-d36f-42d7-8705-7b45a6ea466a tempest-VolumesTransfersTest-970624399 None] Lock "cinder-bf196469-8ae3-4cfc-87ee-ff5020b5dd97-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:32 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-57fef295-e010-47b9-9fc1-13a532a03d64" returned: 0 in 0.462s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Lock "cinder-quobyte-57fef295-e010-47b9-9fc1-13a532a03d64" released by "delete_volume" :: held 1.004s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:32 devstack sudo[87483]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Created reservations ['f2e3c409-397f-46d1-a289-b8a2f2399193'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 1G" returned: 0 in 0.572s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:32 devstack sudo[87492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 Apr 10 12:17:32 devstack sudo[87492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Created reservations ['7df52ce8-907f-4c58-962d-2017bb51eed9', 'a40f2dda-7e42-4576-bf88-5e3f261417cd', '44400d0b-b9e0-4427-beab-31778d255a9a', 'c210acad-84e3-493b-8a38-9510e4417454'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:32 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:32 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:32 devstack sudo[87492]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6" returned: 0 in 0.467s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:32 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 is being set with open permissions: ugo+rw Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:32 devstack sudo[87500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 Apr 10 12:17:32 devstack sudo[87500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:32 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Flow 'volume_create_manager' (418b20c4-8919-4c5c-8704-dda86af906df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c806c446-cc2e-4ca3-b917-5b5aa44c64cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:32 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-928e44ef-a991-4d95-a897-9872e93da018 tempest-GroupsV314Test-1429362433 None] Delete group completed successfully. Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c806c446-cc2e-4ca3-b917-5b5aa44c64cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1106379870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c03c79b-c6bd-4657-b21e-993c167be394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65174969c1ad4599a282b109f19be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:33Z,use_quota=True,user_id='9ad491e4d16946939d76c253f03c1001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4401af-37be-4899-bd69-18ffa737b585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4401af-37be-4899-bd69-18ffa737b585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d4916c-3f85-4562-a19c-5b67f0cdca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d4916c-3f85-4562-a19c-5b67f0cdca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c03c79b-c6bd-4657-b21e-993c167be394', 'volume_name': 'volume-1c03c79b-c6bd-4657-b21e-993c167be394', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed8dace-64d1-4de4-91a6-72b9f052dc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ed8dace-64d1-4de4-91a6-72b9f052dc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9b2419-0e1f-4a25-a053-a65ceeb3ddbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:32 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Volume 1c03c79b-c6bd-4657-b21e-993c167be394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c03c79b-c6bd-4657-b21e-993c167be394', 'volume_size': 1} Apr 10 12:17:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:33 devstack sudo[87500]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6" returned: 0 in 0.446s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:33 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.info Apr 10 12:17:33 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:33 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.info" returned: 0 in 0.474s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:33 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.info is being set with open permissions: ugo+rw Apr 10 12:17:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:33 devstack sudo[87506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.info Apr 10 12:17:33 devstack sudo[87506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:34 devstack sudo[87506]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.info" returned: 0 in 0.499s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.100s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.311s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Creating offline snapshot 4425c609-52cd-46a6-b146-86d8d8549ec8 of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:17:34 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-94859169-4152-40e7-8d62-d92a5d1487e1 tempest-VolumesSnapshotTestJSON-2113475617 None] Create snapshot completed successfully Apr 10 12:17:34 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ea220e-8967-4a41-8eec-7b7affddb344]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:34 devstack sudo[87510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 Apr 10 12:17:34 devstack sudo[87510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:34 devstack sudo[87510]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066" returned: 0 in 0.547s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:34 devstack sudo[87515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 1G Apr 10 12:17:34 devstack sudo[87515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-78fc1c61-fc95-4351-9a26-780a216ee3e6-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-78fc1c61-fc95-4351-9a26-780a216ee3e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-c0f51579-f6d8-486f-afb4-c8538f2444e2" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-c0f51579-f6d8-486f-afb4-c8538f2444e2" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-78fc1c61-fc95-4351-9a26-780a216ee3e6" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-78fc1c61-fc95-4351-9a26-780a216ee3e6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Deleting offline snapshot 78fc1c61-fc95-4351-9a26-780a216ee3e6 of volume c0f51579-f6d8-486f-afb4-c8538f2444e2 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] snapshot_file for this snap is: volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:17:35 devstack sudo[87515]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 1G" returned: 0 in 0.583s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e17e267-933c-4bc8-9184-8f88a33acf09]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:35 devstack sudo[87520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:17:35 devstack sudo[87520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:35 devstack sudo[87521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 Apr 10 12:17:35 devstack sudo[87521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:35 devstack sudo[87520]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.528s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:35 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 is being set with open permissions: ugo+rw Apr 10 12:17:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:35 devstack sudo[87531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:17:35 devstack sudo[87531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:36 devstack sudo[87521]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6" returned: 0 in 0.609s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0f51579-f6d8-486f-afb4-c8538f2444e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[da754f00-d563-4f6a-af03-56bf5a28c27c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:36 devstack sudo[87533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 Apr 10 12:17:36 devstack sudo[87533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:36 devstack sudo[87531]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.483s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:36 devstack sudo[87536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.info Apr 10 12:17:36 devstack sudo[87536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:36 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-508ac361-3d62-4da8-a409-c48b1169b5a3 tempest-GroupsV320Test-301492780 None] Group tempest-GroupsV320Test-Group-516022777: creating Apr 10 12:17:36 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-508ac361-3d62-4da8-a409-c48b1169b5a3 tempest-GroupsV320Test-301492780 None] Group tempest-GroupsV320Test-Group-516022777: created successfully Apr 10 12:17:36 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-508ac361-3d62-4da8-a409-c48b1169b5a3 tempest-GroupsV320Test-301492780 None] Create group completed successfully. Apr 10 12:17:36 devstack sudo[87533]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2" returned: 0 in 0.603s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:36 devstack sudo[87541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 Apr 10 12:17:36 devstack sudo[87541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:36 devstack sudo[87536]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.info" returned: 0 in 0.427s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:36 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.info is being set with open permissions: ugo+rw Apr 10 12:17:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:36 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.info Apr 10 12:17:36 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:37 devstack sudo[87541]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:37 devstack sudo[87549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6 Apr 10 12:17:37 devstack sudo[87549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:37 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.info" returned: 0 in 0.439s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.102s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.388s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1106379870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c03c79b-c6bd-4657-b21e-993c167be394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65174969c1ad4599a282b109f19be137',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:33Z,use_quota=True,user_id='9ad491e4d16946939d76c253f03c1001',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Creating volume 1c03c79b-c6bd-4657-b21e-993c167be394 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:37 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:37 devstack sudo[87552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 1073741824 Apr 10 12:17:37 devstack sudo[87552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:37 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9c91743d-4634-422c-a665-1d9f02b2f38f tempest-SnapshotsActionsTest-924362449 None] Create snapshot completed successfully Apr 10 12:17:37 devstack sudo[87549]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2.78fc1c61-fc95-4351-9a26-780a216ee3e6" returned: 0 in 0.442s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-78fc1c61-fc95-4351-9a26-780a216ee3e6" released by "_delete_snapshot" :: held 2.242s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-c0f51579-f6d8-486f-afb4-c8538f2444e2" released by "delete_snapshot" :: held 2.257s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Created reservations ['84ce0d09-0246-4b34-9635-4a78f2bd4369', 'c875116b-c4ea-4961-9bd0-295b462518a8', '4f6aa578-ef10-4efc-99cb-094432462e42', 'dbc2c931-c77f-44e4-bb89-33a7ec11e009'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:37 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Delete snapshot completed successfully. Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9072318-e338-4e4c-91d2-722b7b686190 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-78fc1c61-fc95-4351-9a26-780a216ee3e6-delete_snapshot" released by "delete_snapshot" :: held 2.380s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Created reservations ['bc0617c3-445d-4847-b619-0bc085159b1e'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:37 devstack sudo[87552]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 1073741824" returned: 0 in 0.576s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:37 devstack sudo[87558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:37 devstack sudo[87558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:37 devstack sudo[87560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 Apr 10 12:17:37 devstack sudo[87560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:38 devstack sudo[87560]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394" returned: 0 in 0.426s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] <== create_volume: return (1046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9b2419-0e1f-4a25-a053-a65ceeb3ddbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c03c79b-c6bd-4657-b21e-993c167be394', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19adf44-fadb-49bb-9661-fe6fd9d8cf2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:38 devstack sudo[87558]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.482s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:38 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-81cc9471-cdff-40c4-ba9a-4a1bce583c0a tempest-GroupsV320Test-301492780 None] Delete group completed successfully. Apr 10 12:17:38 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Volume volume-1c03c79b-c6bd-4657-b21e-993c167be394 (1c03c79b-c6bd-4657-b21e-993c167be394): created successfully Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b19adf44-fadb-49bb-9661-fe6fd9d8cf2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Flow 'volume_create_manager' (418b20c4-8919-4c5c-8704-dda86af906df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:38 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-5e22e24f-44cb-4398-a61e-248c510323c7 tempest-VolumesTransfersTest-2079135555 None] Created volume successfully. Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Creating offline snapshot 8a18f2d2-a744-445c-a412-4379d1ab3202 of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5796aae-e7db-4557-9aef-8822294e9cda]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:38 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:17:38 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (73a4c216-c01d-4f1b-a0b2-bbbf928ec17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5b0a64-bc49-473d-98df-d8cd98bb8f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d5b0a64-bc49-473d-98df-d8cd98bb8f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-916407282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225ff110b6e4bf7b6e4d69d9ff1fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:39Z,use_quota=True,user_id='88261f08fd504c15b73f3acbe4a44200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b62e17b-2505-4ece-890d-1f1e50ed58bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b62e17b-2505-4ece-890d-1f1e50ed58bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9ebb09-00dd-43d2-a4bf-664327a6decb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e9ebb09-00dd-43d2-a4bf-664327a6decb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422', 'volume_name': 'volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f777aa2f-b9dc-47fd-851b-b17c0b04e796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f777aa2f-b9dc-47fd-851b-b17c0b04e796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f785f82c-8c32-4028-a13e-690cedfd3bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:38 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Volume ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422', 'volume_size': 1} Apr 10 12:17:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:39 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.542s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:39 devstack sudo[87569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 1G Apr 10 12:17:39 devstack sudo[87569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Acquiring lock "cinder-1c03c79b-c6bd-4657-b21e-993c167be394-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Lock "cinder-1c03c79b-c6bd-4657-b21e-993c167be394-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:39 devstack sudo[87569]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Acquiring lock "cinder-quobyte-1c03c79b-c6bd-4657-b21e-993c167be394" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 1G" returned: 0 in 0.613s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Lock "cinder-quobyte-1c03c79b-c6bd-4657-b21e-993c167be394" acquired by "delete_volume" :: waited 0.021s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:39 devstack sudo[87574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 Apr 10 12:17:39 devstack sudo[87574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4206e42d-1648-4a61-90b8-b2ccc5b17512]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:39 devstack sudo[87576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 Apr 10 12:17:39 devstack sudo[87576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:40 devstack sudo[87574]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202" returned: 0 in 0.539s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:40 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 is being set with open permissions: ugo+rw Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:40 devstack sudo[87584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 Apr 10 12:17:40 devstack sudo[87584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:40 devstack sudo[87576]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394" returned: 0 in 0.578s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:40 devstack sudo[87586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394 Apr 10 12:17:40 devstack sudo[87586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:40 devstack sudo[87584]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-916407282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225ff110b6e4bf7b6e4d69d9ff1fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:39Z,use_quota=True,user_id='88261f08fd504c15b73f3acbe4a44200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Creating volume ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:40 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:40 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f7e6a8d8-ffef-4f5e-862d-ea59a89b1240 tempest-SnapshotsActionsTest-924362449 None] Create snapshot completed successfully Apr 10 12:17:40 devstack sudo[87586]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:40 devstack sudo[87590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 1073741824 Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1c03c79b-c6bd-4657-b21e-993c167be394" returned: 0 in 0.499s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:40 devstack sudo[87590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Lock "cinder-quobyte-1c03c79b-c6bd-4657-b21e-993c167be394" released by "delete_volume" :: held 1.114s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Created reservations ['45a63990-e4d5-4df3-8479-94afaf4b1245', 'f613016d-6d41-443b-8119-0c3eb3d01edd', '162e0cb7-83cb-49ed-b8f3-baa4ee023a0c', '051c500b-8741-43f9-8c54-2198c92eae41'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:40 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:41 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:41 devstack sudo[87590]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 1073741824" returned: 0 in 0.546s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:41 devstack sudo[87598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 Apr 10 12:17:41 devstack sudo[87598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:41 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.539s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Deleted volume successfully. Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8e97cc04-5380-40fd-b1f6-089bac0654b8 tempest-VolumesTransfersTest-970624399 None] Lock "cinder-1c03c79b-c6bd-4657-b21e-993c167be394-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:41 devstack sudo[87598]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" returned: 0 in 0.526s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] <== create_volume: return (1103ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f785f82c-8c32-4028-a13e-690cedfd3bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d43aa1-2c1e-47b6-a9fb-0aa81549ecfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Volume volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 (ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422): created successfully Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (46d43aa1-2c1e-47b6-a9fb-0aa81549ecfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (73a4c216-c01d-4f1b-a0b2-bbbf928ec17d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-840c1e91-2765-4f07-a1c9-036e2a229b8c tempest-VolumesSnapshotTestJSON-2113475617 None] Created volume successfully. Apr 10 12:17:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-8a18f2d2-a744-445c-a412-4379d1ab3202-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-8a18f2d2-a744-445c-a412-4379d1ab3202-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-quobyte-8a18f2d2-a744-445c-a412-4379d1ab3202" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-8a18f2d2-a744-445c-a412-4379d1ab3202" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Deleting offline snapshot 8a18f2d2-a744-445c-a412-4379d1ab3202 of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] snapshot_file for this snap is: volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2c5cf7d-eb28-4b34-b5c9-00052420321a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:42 devstack sudo[87601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 Apr 10 12:17:42 devstack sudo[87601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:42 devstack sudo[87601]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202" returned: 0 in 0.534s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[65eb1e54-69cd-4cfc-aa7d-eaabaf5a539d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:42 devstack sudo[87606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:17:42 devstack sudo[87606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Creating offline snapshot d475ee05-fd39-48f2-aad6-d3c190cd2dbd of volume ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0995da6-80a3-4af1-b46d-ed561e2ccaf7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Flow 'volume_create_manager' (8ec72f2a-de5f-4456-b1b0-62a314fea494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca875d9-3764-41e8-a1cb-0e147bdecdd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ca875d9-3764-41e8-a1cb-0e147bdecdd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-718771289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddc0c8b-af3f-4628-bfc9-ad264c093069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7681a10e66cb435b8640fd434b6c30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:43Z,use_quota=True,user_id='cbb2e0691f8a4fe0a5cfc9e437c64605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c513af5-c9ed-4699-a0e6-f7e4844e8078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:43 devstack sudo[87606]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c513af5-c9ed-4699-a0e6-f7e4844e8078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:43 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 Apr 10 12:17:43 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145661b6-4784-4b21-9677-a07deae37698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (145661b6-4784-4b21-9677-a07deae37698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cddc0c8b-af3f-4628-bfc9-ad264c093069', 'volume_name': 'volume-cddc0c8b-af3f-4628-bfc9-ad264c093069', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2220315-9bcd-45b4-abc4-f1e55e321985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2220315-9bcd-45b4-abc4-f1e55e321985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55feb20-5975-43a2-8d40-a1ae5ec25469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:43 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Volume cddc0c8b-af3f-4628-bfc9-ad264c093069: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cddc0c8b-af3f-4628-bfc9-ad264c093069', 'volume_size': 1} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.676s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:43 devstack sudo[87614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 Apr 10 12:17:43 devstack sudo[87614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:43 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" returned: 0 in 0.520s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:43 devstack sudo[87628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd 1G Apr 10 12:17:43 devstack sudo[87628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:43 devstack sudo[87614]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202" returned: 0 in 0.537s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:43 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202 Apr 10 12:17:43 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:44 devstack sudo[87628]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd 1G" returned: 0 in 0.527s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:44 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd Apr 10 12:17:44 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:44 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.8a18f2d2-a744-445c-a412-4379d1ab3202" returned: 0 in 0.506s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-8a18f2d2-a744-445c-a412-4379d1ab3202" released by "_delete_snapshot" :: held 2.345s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" released by "delete_snapshot" :: held 2.359s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Created reservations ['0022940a-743e-4543-976b-ababefdbe61e', '46817509-ea04-4c62-8913-0a0ad9858b61', '16b9e64e-6726-49e8-a44e-f81d75f7b5f9', '0a73ce80-3031-4183-a4be-392239ccf5a3'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:44 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Delete snapshot completed successfully. Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a6603734-52e0-49de-a74e-361cec7828d3 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-8a18f2d2-a744-445c-a412-4379d1ab3202-delete_snapshot" released by "delete_snapshot" :: held 2.453s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:44 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd" returned: 0 in 0.512s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:44 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd is being set with open permissions: ugo+rw Apr 10 12:17:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:44 devstack sudo[87642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd Apr 10 12:17:44 devstack sudo[87642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:45 devstack sudo[87642]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd" returned: 0 in 0.408s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:45 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.info Apr 10 12:17:45 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:45 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.info" returned: 0 in 0.483s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:45 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.info is being set with open permissions: ugo+rw Apr 10 12:17:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:45 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.info Apr 10 12:17:45 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:46 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.info" returned: 0 in 0.468s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.876s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-718771289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cddc0c8b-af3f-4628-bfc9-ad264c093069,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7681a10e66cb435b8640fd434b6c30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:43Z,use_quota=True,user_id='cbb2e0691f8a4fe0a5cfc9e437c64605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Creating volume cddc0c8b-af3f-4628-bfc9-ad264c093069 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:46 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:46 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 1073741824 Apr 10 12:17:46 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-09950b0e-6f30-4184-8052-90a073ea5193 tempest-VolumesSnapshotTestJSON-2113475617 None] Create snapshot completed successfully Apr 10 12:17:46 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 1073741824" returned: 0 in 0.526s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:46 devstack sudo[87656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 Apr 10 12:17:46 devstack sudo[87656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:47 devstack sudo[87656]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.764s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Creating offline snapshot 4cc69d66-8214-4f7e-9af3-9a48a77a4eba of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f55feb20-5975-43a2-8d40-a1ae5ec25469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cddc0c8b-af3f-4628-bfc9-ad264c093069', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b500e6b-5031-4513-b9b1-250494b9beb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd72538-c53d-4304-91c8-856c17258f15]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:47 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Volume volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 (cddc0c8b-af3f-4628-bfc9-ad264c093069): created successfully Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b500e6b-5031-4513-b9b1-250494b9beb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Flow 'volume_create_manager' (8ec72f2a-de5f-4456-b1b0-62a314fea494) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c83b39bc-13e3-4321-8ede-29cec83783b8 tempest-VolumeQuotasAdminTestJSON-412582560 None] Created volume successfully. Apr 10 12:17:47 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:17:47 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Acquiring lock "cinder-cddc0c8b-af3f-4628-bfc9-ad264c093069-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "cinder-cddc0c8b-af3f-4628-bfc9-ad264c093069-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Acquiring lock "cinder-quobyte-cddc0c8b-af3f-4628-bfc9-ad264c093069" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "cinder-quobyte-cddc0c8b-af3f-4628-bfc9-ad264c093069" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[263ba4d3-1ea9-47c0-ad8a-84f2d7ee40c2]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:47 devstack sudo[87661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 Apr 10 12:17:47 devstack sudo[87661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (3902b479-d7fe-4840-b2c7-51ef27576ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f01da78-f54d-49eb-a317-0b3c9251274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f01da78-f54d-49eb-a317-0b3c9251274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1650742092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bfbaa4a-375f-40c0-a18b-5f1b194319b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225ff110b6e4bf7b6e4d69d9ff1fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=d475ee05-fd39-48f2-aad6-d3c190cd2dbd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:48Z,use_quota=True,user_id='88261f08fd504c15b73f3acbe4a44200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03aa67ff-53ef-4156-b8ca-595c51b6c694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03aa67ff-53ef-4156-b8ca-595c51b6c694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8097e743-18dd-40d5-af67-5f965d59680d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8097e743-18dd-40d5-af67-5f965d59680d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3bfbaa4a-375f-40c0-a18b-5f1b194319b4', 'volume_name': 'volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4', 'volume_size': 2, 'snapshot_id': 'd475ee05-fd39-48f2-aad6-d3c190cd2dbd'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967e2255-3207-4e93-851b-442b8d63131d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967e2255-3207-4e93-851b-442b8d63131d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269c6d46-263e-4ab5-94b5-b723cce2776f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:47 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Volume 3bfbaa4a-375f-40c0-a18b-5f1b194319b4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4', 'volume_size': 2, 'snapshot_id': 'd475ee05-fd39-48f2-aad6-d3c190cd2dbd'} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:47 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.585s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:47 devstack sudo[87666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba 1G Apr 10 12:17:47 devstack sudo[87666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:48 devstack sudo[87661]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069" returned: 0 in 0.549s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:48 devstack sudo[87671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069 Apr 10 12:17:48 devstack sudo[87671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:48 devstack sudo[87666]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba 1G" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:48 devstack sudo[87676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba Apr 10 12:17:48 devstack sudo[87676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:48 devstack sudo[87671]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cddc0c8b-af3f-4628-bfc9-ad264c093069" returned: 0 in 0.584s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "cinder-quobyte-cddc0c8b-af3f-4628-bfc9-ad264c093069" released by "delete_volume" :: held 1.163s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Created reservations ['7b19f169-e560-4d50-970c-e1ebe1d8bca4', '819a1b3e-c269-405a-9d78-7c14816a8070', '8e99f59c-6537-484b-a415-b1979b857e60', '98ce0526-8cab-4b7b-bf64-397206f55680'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:48 devstack sudo[87679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:48 devstack sudo[87679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:48 devstack sudo[87676]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba" returned: 0 in 0.618s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:48 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba is being set with open permissions: ugo+rw Apr 10 12:17:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:48 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba Apr 10 12:17:48 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:49 devstack sudo[87679]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:49 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Deleted volume successfully. Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3edc0a6c-5faf-43a6-993d-7ea8f5ebccdb tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "cinder-cddc0c8b-af3f-4628-bfc9-ad264c093069-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:49 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba" returned: 0 in 0.497s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.707s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-d475ee05-fd39-48f2-aad6-d3c190cd2dbd-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" by "_create_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-d475ee05-fd39-48f2-aad6-d3c190cd2dbd-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Creating volume 3bfbaa4a-375f-40c0-a18b-5f1b194319b4 from snapshot d475ee05-fd39-48f2-aad6-d3c190cd2dbd {{(pid=82546) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:49 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-00ef6f89-88e6-4764-93b2-66687122efaa tempest-SnapshotsActionsTest-924362449 None] Create snapshot completed successfully Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] snapshot: d475ee05-fd39-48f2-aad6-d3c190cd2dbd, volume: 3bfbaa4a-375f-40c0-a18b-5f1b194319b4, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[143ac783-2aff-4a4f-b39c-bee3147853db]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:49 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd Apr 10 12:17:49 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-4cc69d66-8214-4f7e-9af3-9a48a77a4eba-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-4cc69d66-8214-4f7e-9af3-9a48a77a4eba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-quobyte-4cc69d66-8214-4f7e-9af3-9a48a77a4eba" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-4cc69d66-8214-4f7e-9af3-9a48a77a4eba" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Deleting offline snapshot 4cc69d66-8214-4f7e-9af3-9a48a77a4eba of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] snapshot_file for this snap is: volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9eede85-b7e6-4c4a-a2a9-311815e6ce14]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:50 devstack sudo[87690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba Apr 10 12:17:50 devstack sudo[87690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:50 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Flow 'volume_create_manager' (7536fa8c-2bcc-4745-9772-d724b0749dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca73feb-a224-4dd5-aff9-0a396efdc4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd" returned: 0 in 0.709s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b23b078f-5447-4dd8-adab-e32798fc693c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca73feb-a224-4dd5-aff9-0a396efdc4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1148958977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988d6a9e-563e-4734-9135-19226e01cfd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7681a10e66cb435b8640fd434b6c30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:50Z,use_quota=True,user_id='cbb2e0691f8a4fe0a5cfc9e437c64605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac99820-6b9f-4656-a952-47b6594de65f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ac99820-6b9f-4656-a952-47b6594de65f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b6b1c4-3637-49e4-ad78-ecb65e7275a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0b6b1c4-3637-49e4-ad78-ecb65e7275a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '988d6a9e-563e-4734-9135-19226e01cfd0', 'volume_name': 'volume-988d6a9e-563e-4734-9135-19226e01cfd0', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf041b7-6d72-49ea-9d7f-ba30122508ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf041b7-6d72-49ea-9d7f-ba30122508ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab52385e-420b-473a-b55d-cbed8cae5745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:50 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Volume 988d6a9e-563e-4734-9135-19226e01cfd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-988d6a9e-563e-4734-9135-19226e01cfd0', 'volume_size': 1} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:50 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 Apr 10 12:17:50 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:50 devstack sudo[87690]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba" returned: 0 in 0.733s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b147c4-95e4-4016-afb0-9849f41ed4d6]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:50 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:17:50 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:50 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" returned: 0 in 0.661s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:17:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:50 devstack sudo[87739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 Apr 10 12:17:50 devstack sudo[87739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:51 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.533s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:51 devstack sudo[87744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba Apr 10 12:17:51 devstack sudo[87744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:51 devstack sudo[87744]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba" returned: 0 in 0.761s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:52 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba Apr 10 12:17:52 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:53 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4cc69d66-8214-4f7e-9af3-9a48a77a4eba" returned: 0 in 1.163s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-4cc69d66-8214-4f7e-9af3-9a48a77a4eba" released by "_delete_snapshot" :: held 3.335s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" released by "delete_snapshot" :: held 3.363s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Created reservations ['01df063d-7e74-4039-af25-9e8dab8cedb0', 'f079bf0d-8ef0-445b-96a7-cff5c271519b', 'f0a41715-5e82-4508-97c9-d8ade2448f7c', '91cde2fc-d17c-4490-b475-a0fbb4d8c579'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:53 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Delete snapshot completed successfully. Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3549b401-fd96-4f71-b9d4-864e4bc50223 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-4cc69d66-8214-4f7e-9af3-9a48a77a4eba-delete_snapshot" released by "delete_snapshot" :: held 3.639s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:53 devstack sudo[87739]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" returned: 0 in 2.577s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[214c148b-7fd5-4fd0-8753-6b6aa00236d3]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:53 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 Apr 10 12:17:53 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Flow 'volume_create_manager' (37111827-51f6-47c5-a85d-3a60e690c435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d366945-636d-4593-a351-ede50a232c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d366945-636d-4593-a351-ede50a232c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1317646406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b5eb4a-3d80-478c-a17c-8901c838760d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46110c48de1944359e9d5bbce186277e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:54Z,use_quota=True,user_id='973edfe1330a48b7af5dfaf4da5a99a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb240f97-c17d-40ff-a721-da96938817e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb240f97-c17d-40ff-a721-da96938817e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8b2f12-0297-4392-aaff-71886aa37c00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8b2f12-0297-4392-aaff-71886aa37c00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43b5eb4a-3d80-478c-a17c-8901c838760d', 'volume_name': 'volume-43b5eb4a-3d80-478c-a17c-8901c838760d', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0908f365-8ac5-4256-8c83-d0dcfc5866dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0908f365-8ac5-4256-8c83-d0dcfc5866dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e2ef39-7c56-4472-bba2-c810f922f513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:53 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Volume 43b5eb4a-3d80-478c-a17c-8901c838760d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43b5eb4a-3d80-478c-a17c-8901c838760d', 'volume_size': 1} Apr 10 12:17:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:54 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" returned: 0 in 0.693s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422, size 1024.00 MB, duration 2.58 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:17:54 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Converted 1024.00 MB image at 397.21 MB/s Apr 10 12:17:54 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 is being set with open permissions: ugo+rw Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:54 devstack sudo[87770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 Apr 10 12:17:54 devstack sudo[87770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:54 devstack sudo[87770]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" returned: 0 in 0.434s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" released by "_copy_volume_from_snapshot" :: held 5.139s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-d475ee05-fd39-48f2-aad6-d3c190cd2dbd-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" released by "_create_volume_from_snapshot" :: held 5.164s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.185s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.324s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1148958977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=988d6a9e-563e-4734-9135-19226e01cfd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7681a10e66cb435b8640fd434b6c30db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:50Z,use_quota=True,user_id='cbb2e0691f8a4fe0a5cfc9e437c64605',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Creating volume 988d6a9e-563e-4734-9135-19226e01cfd0 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:54 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:54 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 1073741824 Apr 10 12:17:54 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (269c6d46-263e-4ab5-94b5-b723cce2776f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4', 'volume_size': 2, 'snapshot_id': 'd475ee05-fd39-48f2-aad6-d3c190cd2dbd'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b986b602-ea86-4181-8264-065abad52bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:54 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Volume volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 (3bfbaa4a-375f-40c0-a18b-5f1b194319b4): created successfully Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b986b602-ea86-4181-8264-065abad52bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:54 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (3902b479-d7fe-4840-b2c7-51ef27576ffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:54 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-57f624ab-e006-475b-9e70-bd5f118fd611 tempest-VolumesSnapshotTestJSON-2113475617 None] Created volume successfully. Apr 10 12:17:55 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 1073741824" returned: 0 in 0.476s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:55 devstack sudo[87778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 Apr 10 12:17:55 devstack sudo[87778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-3bfbaa4a-375f-40c0-a18b-5f1b194319b4-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-3bfbaa4a-375f-40c0-a18b-5f1b194319b4-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[769fc7bd-4db5-45a0-9a0f-ad0967f18b1d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:55 devstack sudo[87780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 Apr 10 12:17:55 devstack sudo[87780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:55 devstack sudo[87778]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0" returned: 0 in 0.444s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1317646406',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b5eb4a-3d80-478c-a17c-8901c838760d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46110c48de1944359e9d5bbce186277e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:17:54Z,use_quota=True,user_id='973edfe1330a48b7af5dfaf4da5a99a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Creating volume 43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:17:55 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab52385e-420b-473a-b55d-cbed8cae5745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-988d6a9e-563e-4734-9135-19226e01cfd0', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:55 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d 1073741824 Apr 10 12:17:55 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353fcb5d-9330-4e24-9654-8cbf00ae3aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:55 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Volume volume-988d6a9e-563e-4734-9135-19226e01cfd0 (988d6a9e-563e-4734-9135-19226e01cfd0): created successfully Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353fcb5d-9330-4e24-9654-8cbf00ae3aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Flow 'volume_create_manager' (7536fa8c-2bcc-4745-9772-d724b0749dfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-59a8e6f5-191d-4ad7-b993-445511436aa7 tempest-VolumeQuotasAdminTestJSON-412582560 None] Created volume successfully. Apr 10 12:17:55 devstack sudo[87780]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" returned: 0 in 0.494s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:55 devstack sudo[87788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4 Apr 10 12:17:55 devstack sudo[87788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:56 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d 1073741824" returned: 0 in 0.498s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:56 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:17:56 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:56 devstack sudo[87788]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" returned: 0 in 0.448s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-3bfbaa4a-375f-40c0-a18b-5f1b194319b4" released by "delete_volume" :: held 0.968s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Created reservations ['936c4662-6c40-4d38-883f-062c53035719', '80d683a4-1dda-47c2-bc68-5335464eb762', 'ac9923d8-1649-4c0a-a22d-31e64190a807', '91820d8d-8315-4449-86a8-0be256bd0ef5'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:56 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:56 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:56 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.239s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24e2ef39-7c56-4472-bba2-c810f922f513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b5eb4a-3d80-478c-a17c-8901c838760d', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4c853a-9502-4b16-a5a5-de18f40422ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Creating offline snapshot 84b09375-bbeb-41a5-b0f1-af56c3956990 of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:17:56 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Volume volume-43b5eb4a-3d80-478c-a17c-8901c838760d (43b5eb4a-3d80-478c-a17c-8901c838760d): created successfully Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c4c853a-9502-4b16-a5a5-de18f40422ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Flow 'volume_create_manager' (37111827-51f6-47c5-a85d-3a60e690c435) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85e8e1a-e338-45fe-b014-8bc350b93563]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-4efe6d7c-6249-4e1a-9c91-a1deb601b331 tempest-VolumesActionsTest-2131057061 None] Created volume successfully. Apr 10 12:17:56 devstack sudo[87799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:17:56 devstack sudo[87799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:56 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.486s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Deleted volume successfully. Apr 10 12:17:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-afe4e64d-4e4e-46a0-b275-86fde63db376 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-3bfbaa4a-375f-40c0-a18b-5f1b194319b4-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-912d08cb-aa7a-43d7-9991-85398164dc25 tempest-VolumeQuotasAdminTestJSON-707757765 None] Transfer volume completed successfully. Apr 10 12:17:57 devstack sudo[87799]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.541s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:57 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 1G Apr 10 12:17:57 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-d475ee05-fd39-48f2-aad6-d3c190cd2dbd-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-d475ee05-fd39-48f2-aad6-d3c190cd2dbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-d475ee05-fd39-48f2-aad6-d3c190cd2dbd" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-d475ee05-fd39-48f2-aad6-d3c190cd2dbd" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Deleting offline snapshot d475ee05-fd39-48f2-aad6-d3c190cd2dbd of volume ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] snapshot_file for this snap is: volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff2e3e2f-f4f6-46d7-98c3-7d98dd6e64df]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:57 devstack sudo[87810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd Apr 10 12:17:57 devstack sudo[87810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Acquiring lock "cinder-988d6a9e-563e-4734-9135-19226e01cfd0-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Lock "cinder-988d6a9e-563e-4734-9135-19226e01cfd0-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Acquiring lock "cinder-quobyte-988d6a9e-563e-4734-9135-19226e01cfd0" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Lock "cinder-quobyte-988d6a9e-563e-4734-9135-19226e01cfd0" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:57 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 1G" returned: 0 in 0.764s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[072fb1dc-d771-455e-bc05-16c8bcda3ba9]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:57 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 Apr 10 12:17:57 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:57 devstack sudo[87816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 Apr 10 12:17:57 devstack sudo[87816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:58 devstack sudo[87810]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd" returned: 0 in 0.630s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[292a5775-513e-4f84-b442-3edaef5fddb1]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:58 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 Apr 10 12:17:58 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:58 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990" returned: 0 in 0.491s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:58 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 is being set with open permissions: ugo+rw Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:58 devstack sudo[87831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 Apr 10 12:17:58 devstack sudo[87831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:58 devstack sudo[87816]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0" returned: 0 in 0.532s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:58 devstack sudo[87833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0 Apr 10 12:17:58 devstack sudo[87833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:58 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" returned: 0 in 0.572s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:58 devstack sudo[87838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd Apr 10 12:17:58 devstack sudo[87838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:58 devstack sudo[87833]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-988d6a9e-563e-4734-9135-19226e01cfd0" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:58 devstack sudo[87831]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990" returned: 0 in 0.537s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.413s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Lock "cinder-quobyte-988d6a9e-563e-4734-9135-19226e01cfd0" released by "delete_volume" :: held 1.058s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:58 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7f771da6-f971-45d8-a145-425e3d4a6b7a tempest-SnapshotsActionsTest-924362449 None] Create snapshot completed successfully Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Created reservations ['79623105-82cc-4e10-8a16-d90f02353d19', '00101b76-3145-4323-a43e-843388c88884', 'ec536170-ccc4-4e0c-a8f6-0bb1349bc479', 'c536ed5d-6b55-4bf7-a2cf-f0962d456199'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:59 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:17:59 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:59 devstack sudo[87838]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:59 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd Apr 10 12:17:59 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:59 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.451s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:17:59 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Deleted volume successfully. Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-23f5ef72-184f-4e02-96c2-67ceb47e68ce tempest-VolumeQuotasAdminTestJSON-785531800 None] Lock "cinder-988d6a9e-563e-4734-9135-19226e01cfd0-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-84b09375-bbeb-41a5-b0f1-af56c3956990-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-84b09375-bbeb-41a5-b0f1-af56c3956990-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-quobyte-84b09375-bbeb-41a5-b0f1-af56c3956990" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-84b09375-bbeb-41a5-b0f1-af56c3956990" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Deleting offline snapshot 84b09375-bbeb-41a5-b0f1-af56c3956990 of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] snapshot_file for this snap is: volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f208705c-deee-42af-bb84-1ecfa2cc371e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:17:59 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 Apr 10 12:17:59 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:17:59 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422.d475ee05-fd39-48f2-aad6-d3c190cd2dbd" returned: 0 in 0.451s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-d475ee05-fd39-48f2-aad6-d3c190cd2dbd" released by "_delete_snapshot" :: held 2.224s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" released by "delete_snapshot" :: held 2.235s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Created reservations ['7f08997c-eb0d-4300-a57f-6504ac5a0c3d', 'a0c33ac9-a862-40bf-84cd-6773754a6715', 'ee1220f5-4861-47da-9226-3deacc5595d6', 'ce646a03-22e3-4138-99cc-25a471a3d6ee'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:17:59 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Delete snapshot completed successfully. Apr 10 12:17:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c3ee1a0b-528e-4964-b64b-57c48ca6f962 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-d475ee05-fd39-48f2-aad6-d3c190cd2dbd-delete_snapshot" released by "delete_snapshot" :: held 2.327s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:00 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990" returned: 0 in 0.549s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0919c3fc-c10c-4a71-ac85-3eddcd772a9c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:00 devstack sudo[87856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:18:00 devstack sudo[87856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:00 devstack sudo[87856]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.533s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:00 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 Apr 10 12:18:00 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f9dae1-78b8-49f8-8da3-73caf1bc6069]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:00 devstack sudo[87863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 Apr 10 12:18:00 devstack sudo[87863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:01 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990" returned: 0 in 0.638s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:01 devstack sudo[87871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990 Apr 10 12:18:01 devstack sudo[87871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:01 devstack sudo[87863]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" returned: 0 in 0.559s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:01 devstack sudo[87873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422 Apr 10 12:18:01 devstack sudo[87873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:01 devstack sudo[87871]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.84b09375-bbeb-41a5-b0f1-af56c3956990" returned: 0 in 0.457s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-84b09375-bbeb-41a5-b0f1-af56c3956990" released by "_delete_snapshot" :: held 2.229s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" released by "delete_snapshot" :: held 2.241s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Created reservations ['fc2ec9c3-5f15-4506-8344-26fa95b4e1ba', 'e3ffdd92-b351-42c7-8949-b45c9dfe6698', 'cee81167-72ab-4c1b-b88b-39839e202095', 'ab77e711-48f5-4206-a52a-04f3089cec0e'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:01 devstack sudo[87873]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" returned: 0 in 0.487s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:01 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Delete snapshot completed successfully. Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-84192ae9-1f11-4601-a4a9-9668118040c1 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-84b09375-bbeb-41a5-b0f1-af56c3956990-delete_snapshot" released by "delete_snapshot" :: held 2.365s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422" released by "delete_volume" :: held 1.117s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Created reservations ['f0b396e9-72bb-484d-bd8d-3ce652d3cc6f', 'f6d1351f-137a-4494-92a6-ea5894b81ce8', '2e596fb8-0423-4739-9ece-5376edfbc050', 'd50a4a5e-4b83-4a2b-926f-2a32b4b8e3d1'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:02 devstack sudo[87877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:02 devstack sudo[87877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:02 devstack sudo[87877]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.464s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:02 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Deleted volume successfully. Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fe6bb82c-dc23-433d-b14a-73764e752cfc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-ec5e7d7e-e222-4c1f-82b9-d1abbd6ad422-delete_volume" released by "delete_volume" :: held 1.740s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Creating offline snapshot 83749e3b-6fb6-489d-abd3-2ef0162fd222 of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[de679428-2316-4e20-9dea-4aef02993d4a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:03 devstack sudo[87880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:18:03 devstack sudo[87880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (ccde322a-99ff-4414-9575-54de66085d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb896f1-f738-4ab3-8f80-df1b50a739a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb896f1-f738-4ab3-8f80-df1b50a739a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-541077510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12521b83-5416-42da-897d-7d4f56dde95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225ff110b6e4bf7b6e4d69d9ff1fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:03Z,use_quota=True,user_id='88261f08fd504c15b73f3acbe4a44200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da00082-4a5e-4493-8318-966817ed2f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6da00082-4a5e-4493-8318-966817ed2f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb16e8f-c29f-4c60-be4f-43cbc78aa2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eb16e8f-c29f-4c60-be4f-43cbc78aa2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12521b83-5416-42da-897d-7d4f56dde95c', 'volume_name': 'volume-12521b83-5416-42da-897d-7d4f56dde95c', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92366d5-60e6-484b-99dd-e177dc32a9b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c92366d5-60e6-484b-99dd-e177dc32a9b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34389d3-7f9d-46bf-8f5c-d6a2bf369059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:03 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Volume 12521b83-5416-42da-897d-7d4f56dde95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12521b83-5416-42da-897d-7d4f56dde95c', 'volume_size': 1} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:03 devstack sudo[87880]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.661s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:03 devstack sudo[87886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 1G Apr 10 12:18:03 devstack sudo[87886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:04 devstack sudo[87886]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 1G" returned: 0 in 0.586s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:04 devstack sudo[87904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 Apr 10 12:18:04 devstack sudo[87904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Flow 'volume_create_manager' (e16f935a-982e-42c9-bb05-22a3965997a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8aef09-f707-48f4-bea7-cf4cb18090bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f8aef09-f707-48f4-bea7-cf4cb18090bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2135382698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db173cf-2291-4282-a010-77cd7f0363ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f731370e358447a868b72eeba7bc004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:05Z,use_quota=True,user_id='e1eca6a3c7394ad9bca5b94c0856b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba8f4036-c8fc-4766-a6e3-fd9ac2c7ca1f),volume_type_id=ba8f4036-c8fc-4766-a6e3-fd9ac2c7ca1f)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7e4469-de90-40f5-a66d-b60a84e08410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d7e4469-de90-40f5-a66d-b60a84e08410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac44c64-e8a8-4089-8fb6-cf051ead5c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ac44c64-e8a8-4089-8fb6-cf051ead5c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1db173cf-2291-4282-a010-77cd7f0363ed', 'volume_name': 'volume-1db173cf-2291-4282-a010-77cd7f0363ed', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c9b0be-2f5a-47df-b0eb-592a8651a64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72c9b0be-2f5a-47df-b0eb-592a8651a64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12127f48-d153-4309-adbd-92aa9667c484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:04 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Volume 1db173cf-2291-4282-a010-77cd7f0363ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1db173cf-2291-4282-a010-77cd7f0363ed', 'volume_size': 1} Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:04 devstack sudo[87904]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222" returned: 0 in 0.501s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:04 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 is being set with open permissions: ugo+rw Apr 10 12:18:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:04 devstack sudo[87914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 Apr 10 12:18:04 devstack sudo[87914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:05 devstack sudo[87914]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222" returned: 0 in 0.416s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.644s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-541077510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12521b83-5416-42da-897d-7d4f56dde95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225ff110b6e4bf7b6e4d69d9ff1fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:03Z,use_quota=True,user_id='88261f08fd504c15b73f3acbe4a44200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Creating volume 12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:18:05 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:05 devstack sudo[87917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c 1073741824 Apr 10 12:18:05 devstack sudo[87917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:05 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-fdbcf546-d40c-44ff-8559-55b1328b328a tempest-SnapshotsActionsTest-924362449 None] Create snapshot completed successfully Apr 10 12:18:05 devstack sudo[87917]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c 1073741824" returned: 0 in 0.521s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:05 devstack sudo[87922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c Apr 10 12:18:05 devstack sudo[87922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-83749e3b-6fb6-489d-abd3-2ef0162fd222-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-83749e3b-6fb6-489d-abd3-2ef0162fd222-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:06 devstack sudo[87922]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.579s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-2135382698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1db173cf-2291-4282-a010-77cd7f0363ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f731370e358447a868b72eeba7bc004',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:05Z,use_quota=True,user_id='e1eca6a3c7394ad9bca5b94c0856b6d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ba8f4036-c8fc-4766-a6e3-fd9ac2c7ca1f),volume_type_id=ba8f4036-c8fc-4766-a6e3-fd9ac2c7ca1f)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Creating volume 1db173cf-2291-4282-a010-77cd7f0363ed {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:18:06 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" acquired by "delete_snapshot" :: waited 0.038s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Acquiring lock "cinder-quobyte-83749e3b-6fb6-489d-abd3-2ef0162fd222" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:06 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed 1073741824 Apr 10 12:18:06 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e34389d3-7f9d-46bf-8f5c-d6a2bf369059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12521b83-5416-42da-897d-7d4f56dde95c', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a3c54a-cf05-4f25-a0c1-c67fac920569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:06 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Volume volume-12521b83-5416-42da-897d-7d4f56dde95c (12521b83-5416-42da-897d-7d4f56dde95c): created successfully Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3a3c54a-cf05-4f25-a0c1-c67fac920569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (ccde322a-99ff-4414-9575-54de66085d74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-83749e3b-6fb6-489d-abd3-2ef0162fd222" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Deleting offline snapshot 83749e3b-6fb6-489d-abd3-2ef0162fd222 of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] snapshot_file for this snap is: volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:18:06 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a4d7b659-8569-478b-a80e-88b5fd1dbd9d tempest-VolumesSnapshotTestJSON-2113475617 None] Created volume successfully. Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0938393-fd55-420f-a79c-b4fa3c01d05b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:06 devstack sudo[87927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 Apr 10 12:18:06 devstack sudo[87927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:06 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed 1073741824" returned: 0 in 0.548s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:06 devstack sudo[87935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed Apr 10 12:18:06 devstack sudo[87935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:06 devstack sudo[87927]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222" returned: 0 in 0.565s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6d25a3-0771-4f31-8db1-6750da6327fe]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:06 devstack sudo[87940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:18:06 devstack sudo[87940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:07 devstack sudo[87935]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed" returned: 0 in 0.455s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.481s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12127f48-d153-4309-adbd-92aa9667c484) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1db173cf-2291-4282-a010-77cd7f0363ed', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690ba22e-2a99-45bc-816b-ac8667f63901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Creating offline snapshot 0d90823a-69fe-446f-880f-737f613d0b26 of volume 12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:18:07 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Volume volume-1db173cf-2291-4282-a010-77cd7f0363ed (1db173cf-2291-4282-a010-77cd7f0363ed): created successfully Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (690ba22e-2a99-45bc-816b-ac8667f63901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Flow 'volume_create_manager' (e16f935a-982e-42c9-bb05-22a3965997a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[07f12217-5e6a-4409-adf1-cfe624c85b22]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:07 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-868c5a7f-9d4a-47b9-ae5b-5c86cfd03ded tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Created volume successfully. Apr 10 12:18:07 devstack sudo[87943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c Apr 10 12:18:07 devstack sudo[87943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:07 devstack sudo[87940]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.511s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:07 devstack sudo[87948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 Apr 10 12:18:07 devstack sudo[87948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:07 devstack sudo[87943]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c" returned: 0 in 0.537s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:07 devstack sudo[87956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 1G Apr 10 12:18:07 devstack sudo[87956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:07 devstack sudo[87948]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222" returned: 0 in 0.528s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:07 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222 Apr 10 12:18:07 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:08 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:08 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:08 devstack sudo[87956]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 1G" returned: 0 in 0.656s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12521b83-5416-42da-897d-7d4f56dde95c -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:08 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.83749e3b-6fb6-489d-abd3-2ef0162fd222" returned: 0 in 0.588s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:08 devstack sudo[87989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12521b83-5416-42da-897d-7d4f56dde95c -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 Apr 10 12:18:08 devstack sudo[87989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-83749e3b-6fb6-489d-abd3-2ef0162fd222" released by "_delete_snapshot" :: held 2.279s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:08 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" released by "delete_snapshot" :: held 2.330s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.549s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:08 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d9d05bd2-0d0b-485a-8986-2837aa9a3907 tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Retype volume completed successfully. Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Created reservations ['28c586fb-e32f-4180-9b8a-423c1e854be2', '3dd8fa38-914a-4221-ae19-87fb4859be57', '029275e2-7f96-42ca-b451-898a4c7fbd1e', 'a58a6c76-7222-405c-957e-1fd2cf0e7974'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:08 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Delete snapshot completed successfully. Apr 10 12:18:08 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce4b9924-ee84-4b42-92d4-97bc3b5a84c8 tempest-SnapshotsActionsTest-505250750 None] Lock "cinder-83749e3b-6fb6-489d-abd3-2ef0162fd222-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:09 devstack sudo[87989]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12521b83-5416-42da-897d-7d4f56dde95c -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26" returned: 0 in 0.615s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:09 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 is being set with open permissions: ugo+rw Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:09 devstack sudo[88000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 Apr 10 12:18:09 devstack sudo[88000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Acquiring lock "cinder-1db173cf-2291-4282-a010-77cd7f0363ed-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "cinder-1db173cf-2291-4282-a010-77cd7f0363ed-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Acquiring lock "cinder-quobyte-1db173cf-2291-4282-a010-77cd7f0363ed" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "cinder-quobyte-1db173cf-2291-4282-a010-77cd7f0363ed" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a00a46-3a5e-4007-abd2-5ba11b785e72]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:09 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed Apr 10 12:18:09 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:09 devstack sudo[88000]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26" returned: 0 in 0.555s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:09 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.info Apr 10 12:18:09 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "cinder-4425c609-52cd-46a6-b146-86d8d8549ec8-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-4425c609-52cd-46a6-b146-86d8d8549ec8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "cinder-quobyte-4425c609-52cd-46a6-b146-86d8d8549ec8" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-quobyte-4425c609-52cd-46a6-b146-86d8d8549ec8" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Deleting offline snapshot 4425c609-52cd-46a6-b146-86d8d8549ec8 of volume f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] snapshot_file for this snap is: volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c479c66-42e5-4724-b1a2-2ec471590f47]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:09 devstack sudo[88007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:18:09 devstack sudo[88007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:10 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed" returned: 0 in 0.795s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:10 devstack sudo[88013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed Apr 10 12:18:10 devstack sudo[88013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:10 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.info" returned: 0 in 0.571s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:10 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.info is being set with open permissions: ugo+rw Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:10 devstack sudo[88017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.info Apr 10 12:18:10 devstack sudo[88017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:10 devstack sudo[88007]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.589s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1981110e-ef03-4a78-b4dc-42a5d3794015]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:10 devstack sudo[88020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 Apr 10 12:18:10 devstack sudo[88020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:10 devstack sudo[88013]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-1db173cf-2291-4282-a010-77cd7f0363ed" returned: 0 in 0.500s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "cinder-quobyte-1db173cf-2291-4282-a010-77cd7f0363ed" released by "delete_volume" :: held 1.374s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:10 devstack cinder-volume[82546]: WARNING cinder.quota [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:18:10 devstack cinder-volume[82546]: WARNING cinder.quota [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Created reservations ['c4dd58aa-58dd-4692-9d41-eca8ce3caf99', 'b5ca90b5-1ee1-4af3-81a7-a7e64f5b0664', '585c8bcc-5e2e-4a4b-99ae-b7d6c4b3e616', '7000edf9-2718-4d60-b671-b72dbf4ca287'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:10 devstack sudo[88017]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.info" returned: 0 in 0.635s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.668s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ef2f87fe-45de-4663-afdb-2bb5230912e5 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d" by "attach_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ef2f87fe-45de-4663-afdb-2bb5230912e5 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d" acquired by "attach_volume" :: waited 0.030s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:10 devstack sudo[88024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:10 devstack sudo[88024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-43bda45a-b5ca-4145-ba67-c8cd90b803e8 tempest-VolumesSnapshotTestJSON-2113475617 None] Create snapshot completed successfully Apr 10 12:18:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ef2f87fe-45de-4663-afdb-2bb5230912e5 tempest-VolumesActionsTest-2131057061 None] Attaching volume 43b5eb4a-3d80-478c-a17c-8901c838760d to instance 4c963475-884b-4c35-a331-9a72e92b4aa4 at mountpoint /dev/vdb on host None. Apr 10 12:18:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ef2f87fe-45de-4663-afdb-2bb5230912e5 tempest-VolumesActionsTest-2131057061 None] Attach volume completed successfully. Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ef2f87fe-45de-4663-afdb-2bb5230912e5 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d" released by "attach_volume" :: held 0.086s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:11 devstack sudo[88020]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066" returned: 0 in 0.685s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:11 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:18:11 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:11 devstack sudo[88024]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.424s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Deleted volume successfully. Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b6093673-78af-419b-ae88-51b3c690e12b tempest-VolumeRetypeWithoutMigrationTest-1925343556 None] Lock "cinder-1db173cf-2291-4282-a010-77cd7f0363ed-delete_volume" released by "delete_volume" :: held 2.107s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-984ed3cb-c7de-425c-9bf9-6338b7d48189 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-detach_volume" by "detach_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-984ed3cb-c7de-425c-9bf9-6338b7d48189 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-detach_volume" acquired by "detach_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-984ed3cb-c7de-425c-9bf9-6338b7d48189 tempest-VolumesActionsTest-2131057061 None] Detaching volume 43b5eb4a-3d80-478c-a17c-8901c838760d from instance 4c963475-884b-4c35-a331-9a72e92b4aa4. Apr 10 12:18:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-984ed3cb-c7de-425c-9bf9-6338b7d48189 tempest-VolumesActionsTest-2131057061 None] Detach volume completed successfully. Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-984ed3cb-c7de-425c-9bf9-6338b7d48189 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-detach_volume" released by "detach_volume" :: held 0.046s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:11 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.531s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:11 devstack sudo[88035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8 Apr 10 12:18:11 devstack sudo[88035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:12 devstack sudo[88035]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066.4425c609-52cd-46a6-b146-86d8d8549ec8" returned: 0 in 0.609s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-quobyte-4425c609-52cd-46a6-b146-86d8d8549ec8" released by "_delete_snapshot" :: held 2.513s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" released by "delete_snapshot" :: held 2.527s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Created reservations ['f77013aa-c823-4a20-9593-fce1e8e4ba41', '78bcda65-c11b-4fdc-916b-6b3154cf3794', '19abdfb9-909f-459c-853e-b97ffbba858a', 'beaf14d2-763a-4b45-b2eb-a7f7edd0285f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:12 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Delete snapshot completed successfully. Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6d0e038-4266-48e3-83d4-eae98a130335 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-4425c609-52cd-46a6-b146-86d8d8549ec8-delete_snapshot" released by "delete_snapshot" :: held 2.683s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (092d0ce9-3a27-4718-a620-33093d7be6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e283e5ab-a855-4364-942e-8aa0f3224338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e283e5ab-a855-4364-942e-8aa0f3224338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-422212562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b525d5ea-8824-449d-a786-779835586616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c225ff110b6e4bf7b6e4d69d9ff1fec1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0d90823a-69fe-446f-880f-737f613d0b26,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:12Z,use_quota=True,user_id='88261f08fd504c15b73f3acbe4a44200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2c8f7b-9e07-4a54-bea6-e11c5de0b4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b2c8f7b-9e07-4a54-bea6-e11c5de0b4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8fb9dc-1015-42c1-b4e9-054eeddb035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e8fb9dc-1015-42c1-b4e9-054eeddb035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b525d5ea-8824-449d-a786-779835586616', 'volume_name': 'volume-b525d5ea-8824-449d-a786-779835586616', 'volume_size': 1, 'snapshot_id': '0d90823a-69fe-446f-880f-737f613d0b26'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60935535-1377-4cac-aa06-6344db253c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60935535-1377-4cac-aa06-6344db253c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4c3ad2-7bb5-44d3-9485-1a1f9bc0b455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:12 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Volume b525d5ea-8824-449d-a786-779835586616: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b525d5ea-8824-449d-a786-779835586616', 'volume_size': 1, 'snapshot_id': '0d90823a-69fe-446f-880f-737f613d0b26'} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-0d90823a-69fe-446f-880f-737f613d0b26-b525d5ea-8824-449d-a786-779835586616" by "_create_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-0d90823a-69fe-446f-880f-737f613d0b26-b525d5ea-8824-449d-a786-779835586616" acquired by "_create_volume_from_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Creating volume b525d5ea-8824-449d-a786-779835586616 from snapshot 0d90823a-69fe-446f-880f-737f613d0b26 {{(pid=82546) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-b525d5ea-8824-449d-a786-779835586616" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-b525d5ea-8824-449d-a786-779835586616" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] snapshot: 0d90823a-69fe-446f-880f-737f613d0b26, volume: b525d5ea-8824-449d-a786-779835586616, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f398d344-e13c-4017-917e-b006bed41501]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:12 devstack sudo[88039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 Apr 10 12:18:12 devstack sudo[88039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "cinder-f1a2831d-ea8a-47ab-9b64-34e9c8241066-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-f1a2831d-ea8a-47ab-9b64-34e9c8241066-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f710ba-09c9-46ee-b54d-8cc872c94f0d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:13 devstack sudo[88041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 Apr 10 12:18:13 devstack sudo[88041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:13 devstack sudo[88039]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26" returned: 0 in 0.618s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12521b83-5416-42da-897d-7d4f56dde95c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[71af0efe-746f-45ee-98a8-54f2b14f1c1b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:13 devstack sudo[88046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c Apr 10 12:18:13 devstack sudo[88046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:14 devstack sudo[88041]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066" returned: 0 in 0.923s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:14 devstack sudo[88082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066 Apr 10 12:18:14 devstack sudo[88082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:14 devstack sudo[88046]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c" returned: 0 in 0.831s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:14 devstack sudo[88084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:14 devstack sudo[88084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:14 devstack sudo[88085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 Apr 10 12:18:14 devstack sudo[88085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:14 devstack sudo[88084]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.660s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:14 devstack sudo[88082]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1a2831d-ea8a-47ab-9b64-34e9c8241066" returned: 0 in 0.751s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-quobyte-f1a2831d-ea8a-47ab-9b64-34e9c8241066" released by "delete_volume" :: held 1.709s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:14 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Created reservations ['d5dca14d-5560-48eb-ae6c-f288a8752bff', '2fd4ef02-ed3e-44f2-8979-35b88387be9e', '887581cd-e43f-4936-95c6-f2b2278cbef7', 'ecc7c13e-c055-4685-8844-b14f34ed5ec0'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.019s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:15 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:15 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:16 devstack sudo[88085]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616" returned: 0 in 2.807s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:16 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab02c7cb-3dd7-422b-81f7-f25ff7229806]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:16 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.704s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:16 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Deleted volume successfully. Apr 10 12:18:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52a5c66a-5aed-4b03-89b1-c51f62cf05f8 tempest-SnapshotsActionsTest-924362449 None] Lock "cinder-f1a2831d-ea8a-47ab-9b64-34e9c8241066-delete_volume" released by "delete_volume" :: held 3.956s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:17 devstack sudo[88109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c Apr 10 12:18:17 devstack sudo[88109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:17 devstack sudo[88109]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c" returned: 0 in 0.726s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:17 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c, size 1024.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:18:17 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Converted 1024.00 MB image at 364.60 MB/s Apr 10 12:18:17 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 is being set with open permissions: ugo+rw Apr 10 12:18:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:17 devstack sudo[88114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 Apr 10 12:18:17 devstack sudo[88114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:18 devstack sudo[88114]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616" returned: 0 in 0.576s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-b525d5ea-8824-449d-a786-779835586616" released by "_copy_volume_from_snapshot" :: held 5.626s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-0d90823a-69fe-446f-880f-737f613d0b26-b525d5ea-8824-449d-a786-779835586616" released by "_create_volume_from_snapshot" :: held 5.655s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.665s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df4c3ad2-7bb5-44d3-9485-1a1f9bc0b455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b525d5ea-8824-449d-a786-779835586616', 'volume_size': 1, 'snapshot_id': '0d90823a-69fe-446f-880f-737f613d0b26'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35281154-ccc5-4e76-80b8-0b913067c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:18 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Volume volume-b525d5ea-8824-449d-a786-779835586616 (b525d5ea-8824-449d-a786-779835586616): created successfully Apr 10 12:18:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35281154-ccc5-4e76-80b8-0b913067c99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Flow 'volume_create_manager' (092d0ce9-3a27-4718-a620-33093d7be6dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:18 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-180d5dde-ed27-41fc-8c3c-878e85aa94fb tempest-VolumesSnapshotTestJSON-2113475617 None] Created volume successfully. Apr 10 12:18:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-b525d5ea-8824-449d-a786-779835586616-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-b525d5ea-8824-449d-a786-779835586616-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-b525d5ea-8824-449d-a786-779835586616" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-b525d5ea-8824-449d-a786-779835586616" acquired by "delete_volume" :: waited 0.020s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:19 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[384b12e1-40c2-4ff4-99dd-294b1f9e7439]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:19 devstack sudo[88117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 Apr 10 12:18:19 devstack sudo[88117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:20 devstack sudo[88117]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616" returned: 0 in 0.658s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:20 devstack sudo[88124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616 Apr 10 12:18:20 devstack sudo[88124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:20 devstack sudo[88124]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-b525d5ea-8824-449d-a786-779835586616" returned: 0 in 0.486s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-b525d5ea-8824-449d-a786-779835586616" released by "delete_volume" :: held 1.177s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Created reservations ['c23cd389-c9cf-41ea-88fc-fed704a62bf7', 'ae3e4fed-625b-4c7d-a2d7-7101202a9de0', 'b9115f1e-51a0-40ba-954a-be8140f1560d', 'c0a00b06-369e-4f50-a262-8717c57df221'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:20 devstack sudo[88127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:20 devstack sudo[88127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:21 devstack sudo[88127]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Deleted volume successfully. Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43633cd1-8d6b-4d4c-b232-a77e246be7bc tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-b525d5ea-8824-449d-a786-779835586616-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-0d90823a-69fe-446f-880f-737f613d0b26-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-0d90823a-69fe-446f-880f-737f613d0b26-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-12521b83-5416-42da-897d-7d4f56dde95c" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-12521b83-5416-42da-897d-7d4f56dde95c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-0d90823a-69fe-446f-880f-737f613d0b26" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-0d90823a-69fe-446f-880f-737f613d0b26" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Deleting offline snapshot 0d90823a-69fe-446f-880f-737f613d0b26 of volume 12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] snapshot_file for this snap is: volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5caf2a24-aaf2-478b-b26c-227e9aa67cbd]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:21 devstack sudo[88130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 Apr 10 12:18:21 devstack sudo[88130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:22 devstack sudo[88130]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26" returned: 0 in 0.653s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12521b83-5416-42da-897d-7d4f56dde95c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:22 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e2a546-abeb-46c1-8601-51224cfe08e4]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:22 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c Apr 10 12:18:22 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:22 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c" returned: 0 in 0.602s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:22 devstack sudo[88144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 Apr 10 12:18:22 devstack sudo[88144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:23 devstack sudo[88144]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26" returned: 0 in 0.618s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:23 devstack sudo[88149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26 Apr 10 12:18:23 devstack sudo[88149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:23 devstack sudo[88149]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c.0d90823a-69fe-446f-880f-737f613d0b26" returned: 0 in 0.546s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-0d90823a-69fe-446f-880f-737f613d0b26" released by "_delete_snapshot" :: held 2.483s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-12521b83-5416-42da-897d-7d4f56dde95c" released by "delete_snapshot" :: held 2.495s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Created reservations ['f8e3d923-6e0d-4646-a595-fda55d323fb8', 'daa5fca6-52da-4586-8e7b-94c2e7e775e4', 'ba6f753b-ef95-4682-abdd-6cb932ae040a', '492387a7-cc98-4fe9-a42b-0f617d18377f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:24 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Delete snapshot completed successfully. Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43343f99-043b-4c9a-ac1e-a4d65bf3b8e5 tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-0d90823a-69fe-446f-880f-737f613d0b26-delete_snapshot" released by "delete_snapshot" :: held 2.605s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-12521b83-5416-42da-897d-7d4f56dde95c-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-12521b83-5416-42da-897d-7d4f56dde95c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-12521b83-5416-42da-897d-7d4f56dde95c" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-12521b83-5416-42da-897d-7d4f56dde95c" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b768751c-468b-4d7a-9aa0-e333665b3abe]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:24 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c Apr 10 12:18:24 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:25 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c" returned: 0 in 0.636s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:25 devstack sudo[88158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c Apr 10 12:18:25 devstack sudo[88158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:25 devstack sudo[88158]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-12521b83-5416-42da-897d-7d4f56dde95c" returned: 0 in 0.572s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-12521b83-5416-42da-897d-7d4f56dde95c" released by "delete_volume" :: held 1.262s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Created reservations ['aa5389c1-a16d-4ca3-8770-39b1fd43c11b', '17ed8784-ddfe-4289-b5c1-145ff48daa49', '1dc19cd5-42cf-4998-a6d7-6e9f4b691c46', '2fe7eab6-250b-41a7-9bea-dc1bc509ebe6'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:26 devstack sudo[88161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:26 devstack sudo[88161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:26 devstack sudo[88161]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.457s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:26 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Deleted volume successfully. Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-459f0589-6043-4911-be54-2fcaa0ff0d2c tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-12521b83-5416-42da-897d-7d4f56dde95c-delete_volume" released by "delete_volume" :: held 1.896s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Flow 'volume_create_manager' (820d301c-e3c3-469a-99a5-c2e67322994c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bb62ce-1472-495a-90e1-bc322a68feba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95bb62ce-1472-495a-90e1-bc322a68feba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1565132650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052bd380-a792-4e8e-9ec3-3afdf8a5dec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368202f371a94587b7bbb6daba05ce48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:27Z,use_quota=True,user_id='5cabacee9b874f16b1d92bf8fb9d6515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1282ab1-9c77-46da-b518-8e1fae648e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1282ab1-9c77-46da-b518-8e1fae648e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87131e9c-a99a-4516-a722-8a430461d0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87131e9c-a99a-4516-a722-8a430461d0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052bd380-a792-4e8e-9ec3-3afdf8a5dec0', 'volume_name': 'volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c541ad86-3a62-440c-a310-e976ac133aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c541ad86-3a62-440c-a310-e976ac133aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179d5a74-b37e-44ec-8e6b-16886a37fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:26 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Volume 052bd380-a792-4e8e-9ec3-3afdf8a5dec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0', 'volume_size': 1} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1565132650',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052bd380-a792-4e8e-9ec3-3afdf8a5dec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='368202f371a94587b7bbb6daba05ce48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:27Z,use_quota=True,user_id='5cabacee9b874f16b1d92bf8fb9d6515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Creating volume 052bd380-a792-4e8e-9ec3-3afdf8a5dec0 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:18:26 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-c0f51579-f6d8-486f-afb4-c8538f2444e2-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-c0f51579-f6d8-486f-afb4-c8538f2444e2-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:27 devstack sudo[88164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 1073741824 Apr 10 12:18:27 devstack sudo[88164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "cinder-quobyte-c0f51579-f6d8-486f-afb4-c8538f2444e2" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-c0f51579-f6d8-486f-afb4-c8538f2444e2" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaaf861-8a9f-4670-b3d4-8d5789c8a366]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:27 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 Apr 10 12:18:27 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:27 devstack sudo[88164]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 1073741824" returned: 0 in 0.678s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:27 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2" returned: 0 in 0.601s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:27 devstack sudo[88174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2 Apr 10 12:18:27 devstack sudo[88174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:27 devstack sudo[88176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 Apr 10 12:18:27 devstack sudo[88176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:28 devstack sudo[88176]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0" returned: 0 in 0.606s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] <== create_volume: return (1350ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (179d5a74-b37e-44ec-8e6b-16886a37fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a9ebe2-cbad-4c3e-8d8a-d96525cccdba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:28 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Volume volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 (052bd380-a792-4e8e-9ec3-3afdf8a5dec0): created successfully Apr 10 12:18:28 devstack sudo[88174]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5a9ebe2-cbad-4c3e-8d8a-d96525cccdba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Flow 'volume_create_manager' (820d301c-e3c3-469a-99a5-c2e67322994c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c0f51579-f6d8-486f-afb4-c8538f2444e2" returned: 0 in 0.701s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-quobyte-c0f51579-f6d8-486f-afb4-c8538f2444e2" released by "delete_volume" :: held 1.339s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-897abd7a-5be3-46f2-a380-39789e44dc7f tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Created volume successfully. Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Created reservations ['602550fc-d9a9-4994-8a8f-a13ec0ec3731', '748e6d73-c518-4ab4-81a6-6dbf75ffa379', '5c97792d-7c41-44f7-ad1c-c9cd5d0a1c24', '39c948c2-ac28-4e4e-91e8-4f5b7640c2aa'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:28 devstack sudo[88191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:28 devstack sudo[88191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:28 devstack sudo[88191]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.490s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Deleted volume successfully. Apr 10 12:18:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-58fcf297-c426-4c7e-8b33-fccce07cff0d tempest-VolumesSnapshotTestJSON-2113475617 None] Lock "cinder-c0f51579-f6d8-486f-afb4-c8538f2444e2-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Acquiring lock "cinder-052bd380-a792-4e8e-9ec3-3afdf8a5dec0-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "cinder-052bd380-a792-4e8e-9ec3-3afdf8a5dec0-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Acquiring lock "cinder-quobyte-052bd380-a792-4e8e-9ec3-3afdf8a5dec0" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "cinder-quobyte-052bd380-a792-4e8e-9ec3-3afdf8a5dec0" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:29 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9380a186-43c8-41a9-97ff-6c6b942b5ae0]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:29 devstack sudo[88199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 Apr 10 12:18:29 devstack sudo[88199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:30 devstack sudo[88199]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0" returned: 0 in 0.620s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:30 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0 Apr 10 12:18:30 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:30 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-052bd380-a792-4e8e-9ec3-3afdf8a5dec0" returned: 0 in 0.515s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "cinder-quobyte-052bd380-a792-4e8e-9ec3-3afdf8a5dec0" released by "delete_volume" :: held 1.169s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Created reservations ['de2957a3-b694-4674-b7f7-570ec0d5f36f', '3b7f53cb-8e16-4426-af9d-2532abceeb42', '15003a47-e1b1-4145-8a5c-84a1729c9fc4', 'f195ed9a-509c-41e2-baf0-b7dba175245d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:30 devstack sudo[88208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:30 devstack sudo[88208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:31 devstack sudo[88208]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.516s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:31 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Deleted volume successfully. Apr 10 12:18:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-94f48b86-644e-4344-9cfe-5e666b766755 tempest-VolumeQuotasNegativeTestJSON-1124618158 None] Lock "cinder-052bd380-a792-4e8e-9ec3-3afdf8a5dec0-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:UPDATE=197,cinder:DELETE=15,cinder:SELECT=177,cinder:INSERT=42 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=170,cinder:INSERT=54,cinder:UPDATE=187,cinder:DELETE=15 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Flow 'volume_create_manager' (b61c0fad-eaf1-4785-b59a-b4e9420193a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc57cf5-5135-4e9d-9023-a0520dc80f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fc57cf5-5135-4e9d-9023-a0520dc80f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72023c8-e03c-451d-98d4-fb8326135c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbe348fd6184fc79ffeb9d81f6e376f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:35Z,use_quota=True,user_id='380a55825d9e4f2b8accbd88f6952477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2c21d5-5c1d-453c-93ff-f12a670fcfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce2c21d5-5c1d-453c-93ff-f12a670fcfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cede1046-5cf3-4e25-9ad1-83283d34e3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cede1046-5cf3-4e25-9ad1-83283d34e3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72023c8-e03c-451d-98d4-fb8326135c2f', 'volume_name': 'volume-c72023c8-e03c-451d-98d4-fb8326135c2f', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728ffdc8-97ad-4bab-9720-c41ab3adda04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728ffdc8-97ad-4bab-9720-c41ab3adda04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e37de3d-f1ce-457c-9cee-0397f9e3356d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:35 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Volume c72023c8-e03c-451d-98d4-fb8326135c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72023c8-e03c-451d-98d4-fb8326135c2f', 'volume_size': 1} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72023c8-e03c-451d-98d4-fb8326135c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbe348fd6184fc79ffeb9d81f6e376f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:35Z,use_quota=True,user_id='380a55825d9e4f2b8accbd88f6952477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Creating volume c72023c8-e03c-451d-98d4-fb8326135c2f {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:18:35 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:35 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f 1073741824 Apr 10 12:18:35 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:35 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f 1073741824" returned: 0 in 0.780s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:36 devstack sudo[88246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f Apr 10 12:18:36 devstack sudo[88246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:36 devstack sudo[88246]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:18:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:36 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4e37de3d-f1ce-457c-9cee-0397f9e3356d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72023c8-e03c-451d-98d4-fb8326135c2f', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:36 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7631392-6ba5-4d49-bf9d-5957609910eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:36 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Volume volume-c72023c8-e03c-451d-98d4-fb8326135c2f (c72023c8-e03c-451d-98d4-fb8326135c2f): created successfully Apr 10 12:18:36 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7631392-6ba5-4d49-bf9d-5957609910eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:36 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Flow 'volume_create_manager' (b61c0fad-eaf1-4785-b59a-b4e9420193a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:36 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-cfec72c5-4178-48c9-87d1-33b8b32ac439 tempest-CinderUnicodeTest-2118614580 None] Created volume successfully. Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Flow 'volume_create_manager' (b071b6c6-f908-42d4-b6e4-1fe39aca41bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cfb597-def8-43c4-8c88-ae9b98f361c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89cfb597-def8-43c4-8c88-ae9b98f361c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-777313540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cbf977-c4d2-4b10-907c-03840a4a5a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbe348fd6184fc79ffeb9d81f6e376f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:38Z,use_quota=True,user_id='380a55825d9e4f2b8accbd88f6952477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c5f3b3-1884-4f44-883b-92f84b55d980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c5f3b3-1884-4f44-883b-92f84b55d980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48184084-b189-45bc-bd7a-23793b665d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48184084-b189-45bc-bd7a-23793b665d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17cbf977-c4d2-4b10-907c-03840a4a5a2a', 'volume_name': 'volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0835a7fb-9877-4452-9c28-f4e205ad93ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0835a7fb-9877-4452-9c28-f4e205ad93ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ada9daf-d899-46db-8d85-0274fa2b5b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:37 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Volume 17cbf977-c4d2-4b10-907c-03840a4a5a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a', 'volume_size': 1} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:37Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-777313540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cbf977-c4d2-4b10-907c-03840a4a5a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbe348fd6184fc79ffeb9d81f6e376f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:38Z,use_quota=True,user_id='380a55825d9e4f2b8accbd88f6952477',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Creating volume 17cbf977-c4d2-4b10-907c-03840a4a5a2a {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:18:37 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:18:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:37 devstack sudo[88259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a 1073741824 Apr 10 12:18:37 devstack sudo[88259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:38 devstack sudo[88259]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a 1073741824" returned: 0 in 0.700s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:38 devstack sudo[88265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a Apr 10 12:18:38 devstack sudo[88265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:39 devstack sudo[88265]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a" returned: 0 in 0.562s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] <== create_volume: return (1297ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.301s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ada9daf-d899-46db-8d85-0274fa2b5b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0825f013-da51-477d-adc1-1e43508c2850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:39 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Volume volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a (17cbf977-c4d2-4b10-907c-03840a4a5a2a): created successfully Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0825f013-da51-477d-adc1-1e43508c2850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Flow 'volume_create_manager' (b071b6c6-f908-42d4-b6e4-1fe39aca41bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:39 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f730cb80-f51d-4ed3-bf20-68512c9b4287 tempest-CinderUnicodeTest-2118614580 None] Created volume successfully. Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Creating offline snapshot 105e393e-9319-4b31-a8f8-b119875a5160 of volume 17cbf977-c4d2-4b10-907c-03840a4a5a2a {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:18:40 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2586bb9-de3d-40ba-97be-e326fbed54ea]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:40 devstack sudo[88268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a Apr 10 12:18:40 devstack sudo[88268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:40 devstack sudo[88268]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a" returned: 0 in 0.547s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:40 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 1G Apr 10 12:18:40 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:41 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 1G" returned: 0 in 0.579s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:41 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 Apr 10 12:18:41 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:41 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160" returned: 0 in 0.537s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:41 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 is being set with open permissions: ugo+rw Apr 10 12:18:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:41 devstack sudo[88283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 Apr 10 12:18:41 devstack sudo[88283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:42 devstack sudo[88283]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160" returned: 0 in 0.474s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:42 devstack sudo[88286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.info Apr 10 12:18:42 devstack sudo[88286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:42 devstack sudo[88286]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.info" returned: 0 in 0.450s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:42 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.info is being set with open permissions: ugo+rw Apr 10 12:18:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:42 devstack sudo[88289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.info Apr 10 12:18:42 devstack sudo[88289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:43 devstack sudo[88289]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.info" returned: 0 in 0.588s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.245s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:43 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0930d9e0-2c1c-464a-9320-2e94370ad27f tempest-CinderUnicodeTest-2118614580 None] Create snapshot completed successfully Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "cinder-105e393e-9319-4b31-a8f8-b119875a5160-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-105e393e-9319-4b31-a8f8-b119875a5160-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "cinder-quobyte-17cbf977-c4d2-4b10-907c-03840a4a5a2a" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-quobyte-17cbf977-c4d2-4b10-907c-03840a4a5a2a" acquired by "delete_snapshot" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "cinder-quobyte-105e393e-9319-4b31-a8f8-b119875a5160" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-quobyte-105e393e-9319-4b31-a8f8-b119875a5160" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Deleting offline snapshot 105e393e-9319-4b31-a8f8-b119875a5160 of volume 17cbf977-c4d2-4b10-907c-03840a4a5a2a {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] snapshot_file for this snap is: volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c78810ac-5aed-46d4-a3e3-253924d7e269]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:44 devstack sudo[88302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 Apr 10 12:18:44 devstack sudo[88302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:45 devstack sudo[88302]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160" returned: 0 in 0.966s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:18:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[810720bc-774d-4af0-8b22-4b67493b6bea]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:45 devstack sudo[88323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a Apr 10 12:18:45 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:46 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a" returned: 0 in 0.706s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:46 devstack sudo[88330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 Apr 10 12:18:46 devstack sudo[88330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3b994708-a782-4453-859e-94722978493e tempest-VolumesActionsTest-2131057061 None] Acquiring lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d" by "attach_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3b994708-a782-4453-859e-94722978493e tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d" acquired by "attach_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3b994708-a782-4453-859e-94722978493e tempest-VolumesActionsTest-2131057061 None] Attaching volume 43b5eb4a-3d80-478c-a17c-8901c838760d to instance 590b2971-e580-4594-92b6-81ac80004387 at mountpoint /dev/vdb on host None. Apr 10 12:18:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3b994708-a782-4453-859e-94722978493e tempest-VolumesActionsTest-2131057061 None] Attach volume completed successfully. Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3b994708-a782-4453-859e-94722978493e tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d" released by "attach_volume" :: held 0.059s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:46 devstack sudo[88330]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160" returned: 0 in 0.596s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:46 devstack sudo[88335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160 Apr 10 12:18:46 devstack sudo[88335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d44b76c0-d413-4aaf-9f2b-a49d2f218d79 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-detach_volume" by "detach_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d44b76c0-d413-4aaf-9f2b-a49d2f218d79 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d44b76c0-d413-4aaf-9f2b-a49d2f218d79 tempest-VolumesActionsTest-2131057061 None] Detaching volume 43b5eb4a-3d80-478c-a17c-8901c838760d from instance 590b2971-e580-4594-92b6-81ac80004387. Apr 10 12:18:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d44b76c0-d413-4aaf-9f2b-a49d2f218d79 tempest-VolumesActionsTest-2131057061 None] Detach volume completed successfully. Apr 10 12:18:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d44b76c0-d413-4aaf-9f2b-a49d2f218d79 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:47 devstack sudo[88335]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a.105e393e-9319-4b31-a8f8-b119875a5160" returned: 0 in 0.600s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-quobyte-105e393e-9319-4b31-a8f8-b119875a5160" released by "_delete_snapshot" :: held 2.944s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-quobyte-17cbf977-c4d2-4b10-907c-03840a4a5a2a" released by "delete_snapshot" :: held 2.966s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Created reservations ['dbb8fa6e-0eb1-46c6-a41b-afd2c515ca94', 'e5dcc3cd-9bab-4a18-b19e-c8f4b8d35bfc', 'b6e2fcb9-6e04-4893-9d01-4aeb2109fc2c', 'f9d5f1c8-b481-4f9d-bcc5-14c19f98405f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Delete snapshot completed successfully. Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-4de75f9b-5a76-436a-8ffc-8c711f4e5ca3 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-105e393e-9319-4b31-a8f8-b119875a5160-delete_snapshot" released by "delete_snapshot" :: held 3.140s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "cinder-17cbf977-c4d2-4b10-907c-03840a4a5a2a-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-17cbf977-c4d2-4b10-907c-03840a4a5a2a-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "cinder-quobyte-17cbf977-c4d2-4b10-907c-03840a4a5a2a" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-quobyte-17cbf977-c4d2-4b10-907c-03840a4a5a2a" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe0487cb-bf74-49f4-a426-31ff7deb3c2c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:47 devstack sudo[88342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a Apr 10 12:18:47 devstack sudo[88342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:48 devstack sudo[88342]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a" returned: 0 in 0.652s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:48 devstack sudo[88347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a Apr 10 12:18:48 devstack sudo[88347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:49 devstack sudo[88347]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-17cbf977-c4d2-4b10-907c-03840a4a5a2a" returned: 0 in 0.805s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-quobyte-17cbf977-c4d2-4b10-907c-03840a4a5a2a" released by "delete_volume" :: held 1.509s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Created reservations ['f0bd7588-9d9d-43cd-aab9-f81b4fc1be17', '483fe991-b293-4125-8d0e-c98ededfd188', 'f667be19-8438-4ea5-9a5e-57352ebd8cf4', '3557472b-35c7-4d7d-a792-cdd06bc95287'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:49 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:49 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "cinder-c72023c8-e03c-451d-98d4-fb8326135c2f-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-c72023c8-e03c-451d-98d4-fb8326135c2f-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "cinder-quobyte-c72023c8-e03c-451d-98d4-fb8326135c2f" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-quobyte-c72023c8-e03c-451d-98d4-fb8326135c2f" acquired by "delete_volume" :: waited 0.023s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc5ca9e-782b-4673-ac91-370f08f146eb]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:50 devstack sudo[88420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f Apr 10 12:18:50 devstack sudo[88420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:50 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.069s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:50 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Deleted volume successfully. Apr 10 12:18:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-185ef751-2327-4d64-bf50-2401c5562eb5 tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-17cbf977-c4d2-4b10-907c-03840a4a5a2a-delete_volume" released by "delete_volume" :: held 2.865s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:50 devstack sudo[88420]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f" returned: 0 in 0.779s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:50 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f Apr 10 12:18:50 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:51 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c72023c8-e03c-451d-98d4-fb8326135c2f" returned: 0 in 0.895s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-quobyte-c72023c8-e03c-451d-98d4-fb8326135c2f" released by "delete_volume" :: held 1.757s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (96261380-5f53-4634-afef-10eaeb95d32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0d881f-4a4e-4c41-a16d-80cfac27224e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0d881f-4a4e-4c41-a16d-80cfac27224e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1929560893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fd3125-c9b3-44db-bec3-b2e02b3aa572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:52Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5478e04-0ecd-474e-965c-c115061366a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5478e04-0ecd-474e-965c-c115061366a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3aa6eeb-efa0-4c27-b443-d4ae732435b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3aa6eeb-efa0-4c27-b443-d4ae732435b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6fd3125-c9b3-44db-bec3-b2e02b3aa572', 'volume_name': 'volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaf2eea-d5ad-4f1f-86d1-e98b346a8aaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daaf2eea-d5ad-4f1f-86d1-e98b346a8aaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28587753-4517-4ade-b1d0-47dedecd6b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:51 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Volume c6fd3125-c9b3-44db-bec3-b2e02b3aa572: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572', 'volume_size': 1} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1929560893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6fd3125-c9b3-44db-bec3-b2e02b3aa572,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:52Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Creating volume c6fd3125-c9b3-44db-bec3-b2e02b3aa572 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:18:51 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:51 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 1073741824 Apr 10 12:18:51 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Created reservations ['15491522-0849-43f1-8f8e-08e98024b0e0', '06ed0ed4-d0b6-4e9c-b466-e65fd15e348f', '1e77b985-2434-4a7f-aaa2-a679a4da7ffc', 'dec475c8-7fbe-4eca-995d-83ef5fceeedd'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:51 devstack sudo[88467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:51 devstack sudo[88467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:52 devstack sudo[88467]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:52 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:18:52 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Deleted volume successfully. Apr 10 12:18:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9cd0ec58-a403-4890-b56e-c88007f0d59d tempest-CinderUnicodeTest-2118614580 None] Lock "cinder-c72023c8-e03c-451d-98d4-fb8326135c2f-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:52 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 1073741824" returned: 0 in 0.821s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:52 devstack sudo[88473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 Apr 10 12:18:52 devstack sudo[88473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:53 devstack sudo[88473]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" returned: 0 in 0.638s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28587753-4517-4ade-b1d0-47dedecd6b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac087d5-fb15-4a1d-b7a6-bca817025795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:53 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Volume volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 (c6fd3125-c9b3-44db-bec3-b2e02b3aa572): created successfully Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ac087d5-fb15-4a1d-b7a6-bca817025795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (96261380-5f53-4634-afef-10eaeb95d32f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:53 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b88123b6-4d9e-418a-bbd1-d0b5f6ce8c03 tempest-VolumesActionsTest-82281532 None] Created volume successfully. Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f09840d-0abf-4b5f-8183-73021854bf1d tempest-VolumesActionsTest-82281532 None] Acquiring lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" by "attach_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f09840d-0abf-4b5f-8183-73021854bf1d tempest-VolumesActionsTest-82281532 None] Lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" acquired by "attach_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:53 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9f09840d-0abf-4b5f-8183-73021854bf1d tempest-VolumesActionsTest-82281532 None] Attaching volume c6fd3125-c9b3-44db-bec3-b2e02b3aa572 to instance 253a64a6-b0c6-495e-9537-15e0269db501 at mountpoint /dev/vdb on host None. Apr 10 12:18:53 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9f09840d-0abf-4b5f-8183-73021854bf1d tempest-VolumesActionsTest-82281532 None] Attach volume completed successfully. Apr 10 12:18:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f09840d-0abf-4b5f-8183-73021854bf1d tempest-VolumesActionsTest-82281532 None] Lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" released by "attach_volume" :: held 0.075s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:54 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-742766a6-146d-42fe-9c16-6e2bed83ce39 tempest-VolumesActionsTest-1349652478 None] Terminate volume connection completed successfully. Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3049a82-cced-40f1-a1d7-a47fc0fa1bff]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:55 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:18:55 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-742766a6-146d-42fe-9c16-6e2bed83ce39 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-detach_volume" by "detach_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-742766a6-146d-42fe-9c16-6e2bed83ce39 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-742766a6-146d-42fe-9c16-6e2bed83ce39 tempest-VolumesActionsTest-1349652478 None] Detaching volume c6fd3125-c9b3-44db-bec3-b2e02b3aa572 from instance 253a64a6-b0c6-495e-9537-15e0269db501. Apr 10 12:18:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-742766a6-146d-42fe-9c16-6e2bed83ce39 tempest-VolumesActionsTest-1349652478 None] Detach volume completed successfully. Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-742766a6-146d-42fe-9c16-6e2bed83ce39 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-detach_volume" released by "detach_volume" :: held 0.043s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:55 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.554s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a442596-e595-4022-836d-a04389d3950f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:55 devstack sudo[88484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:18:55 devstack sudo[88484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-144efeeb-89f4-4719-bb0c-e9b9e8e7d8df tempest-VolumesActionsTest-82281532 None] Acquiring lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-detach_volume" by "detach_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-144efeeb-89f4-4719-bb0c-e9b9e8e7d8df tempest-VolumesActionsTest-82281532 None] Lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-detach_volume" acquired by "detach_volume" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-144efeeb-89f4-4719-bb0c-e9b9e8e7d8df tempest-VolumesActionsTest-82281532 None] Volume detach called, but volume not attached. Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-144efeeb-89f4-4719-bb0c-e9b9e8e7d8df tempest-VolumesActionsTest-82281532 None] Lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-detach_volume" released by "detach_volume" :: held 0.018s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:56 devstack sudo[88484]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.515s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.8e79c754-44de-43ec-9655-546b94ee2b428wmc8un9.img {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:56 devstack sudo[88489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.8e79c754-44de-43ec-9655-546b94ee2b428wmc8un9.img Apr 10 12:18:56 devstack sudo[88489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Acquiring lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Acquiring lock "cinder-quobyte-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Lock "cinder-quobyte-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a4903ab-2e23-40b5-9caa-ed3824dfb476]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:57 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 Apr 10 12:18:57 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:58 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" returned: 0 in 2.142s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:58 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572 Apr 10 12:18:58 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:58 devstack sudo[88489]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.8e79c754-44de-43ec-9655-546b94ee2b428wmc8un9.img" returned: 0 in 2.602s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:58 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ba02c1-8059-4357-bd04-43b41357fc90]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:59 devstack sudo[88508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:18:59 devstack sudo[88508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Flow 'volume_create_manager' (56b20b88-2536-4fff-8db5-b2c61910aa5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3560fb7c-c8b9-4467-8256-c8e5290699ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3560fb7c-c8b9-4467-8256-c8e5290699ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-927546552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e235565-9c26-467a-b7a1-9a674eb0e9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cd274330e54a3dbb31f0afa4fcd8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:59Z,use_quota=True,user_id='07b0636ef85547a88e982b44e37d1419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84308933-8c6e-453c-87af-46d31930a832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84308933-8c6e-453c-87af-46d31930a832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1b6b93-62da-4dd5-9d13-dcea9cccd946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.image.glance [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Creating Keystone auth plugin from conf {{(pid=82546) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1b6b93-62da-4dd5-9d13-dcea9cccd946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e235565-9c26-467a-b7a1-9a674eb0e9ed', 'volume_name': 'volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c944a9-1f78-4bf1-bd8b-117b16a314c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0c944a9-1f78-4bf1-bd8b-117b16a314c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d61f95-2c20-4336-936e-d0cb2b9ebd0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:18:59 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Volume 9e235565-9c26-467a-b7a1-9a674eb0e9ed: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Trying to clone 9e235565-9c26-467a-b7a1-9a674eb0e9ed from image 35717e41-b49c-4e85-9a50-2d2207b8655c at location (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]). {{(pid=82546) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 12:18:59 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" returned: 0 in 0.536s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Lock "cinder-quobyte-c6fd3125-c9b3-44db-bec3-b2e02b3aa572" released by "delete_volume" :: held 2.708s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Created reservations ['bd0c8a44-8300-43d8-b151-79c5f28def79', '4d525b58-1efe-484a-9f65-99f05f3c38d0', '563b12df-db5a-4f99-8c50-6a6b10fd3138', '47c9d7d7-90b7-4ce2-aa22-93edc96e75be'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 12:18:59 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Image download 20.69 MB at 20.69 MB/s Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a63639-e925-46ff-99e0-70e65c64919c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:18:59 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:18:59 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:59 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD Apr 10 12:18:59 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:18:59 devstack sudo[88508]: pam_unix(sudo:session): session closed for user root Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.816s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d, size 1024.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.8e79c754-44de-43ec-9655-546b94ee2b428wmc8un9.img {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:18:59 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Converted 1024.00 MB image at 393.29 MB/s Apr 10 12:18:59 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] 8e79c754-44de-43ec-9655-546b94ee2b42 was raw, no need to convert to raw {{(pid=82546) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 10 12:19:00 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.428s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:00 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Deleted volume successfully. Apr 10 12:19:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0e75a719-b87a-426d-9c84-a796aae0b8f8 tempest-VolumesActionsTest-82281532 None] Lock "cinder-c6fd3125-c9b3-44db-bec3-b2e02b3aa572-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:00 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD" returned: 0 in 0.668s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:00 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Temporary image 35717e41-b49c-4e85-9a50-2d2207b8655c is fetched for user 07b0636ef85547a88e982b44e37d1419. {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 12:19:00 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3c8767-41c2-4930-adc4-e05a73731b6d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:00 devstack sudo[88524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD Apr 10 12:19:00 devstack sudo[88524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:00 devstack sudo[88524]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD" returned: 0 in 0.597s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (de753bf0-874b-4ceb-b69b-b99483db653b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4988e1-0773-4840-b9d1-9f7b8153a46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4988e1-0773-4840-b9d1-9f7b8153a46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1430694870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad29a637-e170-4678-b7bc-a380b997b8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:08Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2503375-a3ed-4196-b485-8c6ef2d491a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2503375-a3ed-4196-b485-8c6ef2d491a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd27a8a5-9ca5-4780-9cd0-c9602dc80b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd27a8a5-9ca5-4780-9cd0-c9602dc80b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad29a637-e170-4678-b7bc-a380b997b8e4', 'volume_name': 'volume-ad29a637-e170-4678-b7bc-a380b997b8e4', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ffa488-4ae2-48f7-84dd-fc446d3ccd7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ffa488-4ae2-48f7-84dd-fc446d3ccd7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac1ea65-35e7-4ed5-919f-118c21aec140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:07 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Volume ad29a637-e170-4678-b7bc-a380b997b8e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad29a637-e170-4678-b7bc-a380b997b8e4', 'volume_size': 1} Apr 10 12:19:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.512s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Uploaded volume to glance image-id: 8e79c754-44de-43ec-9655-546b94ee2b42. {{(pid=82546) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.802s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-927546552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e235565-9c26-467a-b7a1-9a674eb0e9ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5cd274330e54a3dbb31f0afa4fcd8e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:18:59Z,use_quota=True,user_id='07b0636ef85547a88e982b44e37d1419',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Creating volume 9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:09 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:09 devstack sudo[88558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed 1073741824 Apr 10 12:19:09 devstack sudo[88558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:09 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2acadae5-c9ab-4803-ad12-81b5962dbb3d tempest-VolumesActionsTest-2131057061 None] Copy volume to image completed successfully. Apr 10 12:19:10 devstack sudo[88558]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed 1073741824" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:10 devstack sudo[88563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed Apr 10 12:19:10 devstack sudo[88563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:10 devstack sudo[88563]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed" returned: 0 in 0.412s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.988s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1430694870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad29a637-e170-4678-b7bc-a380b997b8e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:08Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Creating volume ad29a637-e170-4678-b7bc-a380b997b8e4 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:10 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:10 devstack sudo[88566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 1073741824 Apr 10 12:19:10 devstack sudo[88566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Attempting download of 35717e41-b49c-4e85-9a50-2d2207b8655c ((None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}])) to volume 9e235565-9c26-467a-b7a1-9a674eb0e9ed. {{(pid=82546) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e05595e-1317-4f01-afeb-ebe6ce02ba24]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_tsspr7ze {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:10 devstack sudo[88568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_tsspr7ze Apr 10 12:19:10 devstack sudo[88568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:11 devstack sudo[88566]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 1073741824" returned: 0 in 0.542s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:11 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 Apr 10 12:19:11 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:11 devstack sudo[88568]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_tsspr7ze" returned: 0 in 0.552s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_tsspr7ze {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:11 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_tsspr7ze Apr 10 12:19:11 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:11 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4" returned: 0 in 0.437s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.317s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac1ea65-35e7-4ed5-919f-118c21aec140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad29a637-e170-4678-b7bc-a380b997b8e4', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f744d0f-5b31-4de9-b0a0-d1effbc4fe78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a544d0e-e60c-4935-aa6e-d2d855bb8138]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:11 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Volume volume-ad29a637-e170-4678-b7bc-a380b997b8e4 (ad29a637-e170-4678-b7bc-a380b997b8e4): created successfully Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f744d0f-5b31-4de9-b0a0-d1effbc4fe78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (de753bf0-874b-4ceb-b69b-b99483db653b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-81b699ac-89b8-4666-9b2e-1508c618b836 tempest-VolumesActionsTest-82281532 None] Created volume successfully. Apr 10 12:19:11 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:19:11 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:11 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_tsspr7ze" returned: 1 in 0.482s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_tsspr7ze' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9ff710c-a334-4067-8761-36aed353ba86]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:11 devstack sudo[88584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD Apr 10 12:19:11 devstack sudo[88584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-ad29a637-e170-4678-b7bc-a380b997b8e4-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-ad29a637-e170-4678-b7bc-a380b997b8e4-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-quobyte-ad29a637-e170-4678-b7bc-a380b997b8e4" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-quobyte-ad29a637-e170-4678-b7bc-a380b997b8e4" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e184816-ff2a-41df-a92c-3f558ba72b82]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:12 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 Apr 10 12:19:12 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:12 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.513s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[07be7090-c304-4779-8d68-7a0573d2f0fc]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:12 devstack sudo[88594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:19:12 devstack sudo[88594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:12 devstack sudo[88584]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD" returned: 0 in 0.512s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] 35717e41-b49c-4e85-9a50-2d2207b8655c was qcow2, converting to raw {{(pid=82546) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:12 devstack sudo[88596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed Apr 10 12:19:12 devstack sudo[88596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:12 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4" returned: 0 in 0.497s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:12 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4 Apr 10 12:19:12 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:12 devstack sudo[88594]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.510s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:12 devstack sudo[88621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img Apr 10 12:19:12 devstack sudo[88621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:12 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ad29a637-e170-4678-b7bc-a380b997b8e4" returned: 0 in 0.431s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-quobyte-ad29a637-e170-4678-b7bc-a380b997b8e4" released by "delete_volume" :: held 0.974s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Created reservations ['d5634443-72f4-4ac8-a6f3-a27e80021c52', 'e801394f-936d-4d97-a463-1848d5b5de5d', 'b0590136-4549-49bb-aaea-c56cf8ab71a5', '67213037-1967-4ced-9a11-89b36ce489a0'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:13 devstack sudo[88624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:13 devstack sudo[88624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:13 devstack sudo[88596]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed" returned: 0 in 0.984s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_gwq5tnc2devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:19:13 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Converted 112.00 MB image at 112.00 MB/s Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:13 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed 1G Apr 10 12:19:13 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (39628b9e-87f9-4cde-8340-24853fc4eedc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58725f1-bf6d-47b9-a9b4-1070124318bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c58725f1-bf6d-47b9-a9b4-1070124318bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1414469414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6425cb-b58e-4834-ba9f-e187497b84ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:13Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8f10d6-457c-457e-b794-eb373355d005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e8f10d6-457c-457e-b794-eb373355d005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5356b689-6648-4089-abf5-c6b8b2013297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5356b689-6648-4089-abf5-c6b8b2013297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff6425cb-b58e-4834-ba9f-e187497b84ef', 'volume_name': 'volume-ff6425cb-b58e-4834-ba9f-e187497b84ef', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7f0366-6d8c-4953-a574-f3093d1b2116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a7f0366-6d8c-4953-a574-f3093d1b2116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9827b5c4-716b-4f4b-a321-5565aaa35686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:13 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Volume ff6425cb-b58e-4834-ba9f-e187497b84ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff6425cb-b58e-4834-ba9f-e187497b84ef', 'volume_size': 1} Apr 10 12:19:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:14 devstack sudo[88640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:14 devstack sudo[88640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:14 devstack sudo[88624]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.415s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:14 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Deleted volume successfully. Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-48ca5073-6f76-47a2-82d2-41f1b4ce9af8 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-ad29a637-e170-4678-b7bc-a380b997b8e4-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:14 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed 1G" returned: 0 in 1.492s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8cb042-2fc4-460b-94fd-b2c32fda6768]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:15 devstack sudo[88645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed Apr 10 12:19:15 devstack sudo[88645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:15 devstack sudo[88640]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.095s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:15 devstack sudo[88621]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img" returned: 0 in 2.416s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b5527-f0c5-4604-8c70-8ee2b3c719fc]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:15 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:19:15 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:15 devstack sudo[88645]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed" returned: 0 in 0.577s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:15 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed Apr 10 12:19:15 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:15 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.603s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d, size 1024.00 MB, duration 2.42 sec, destination /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:19:15 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Converted 1024.00 MB image at 423.75 MB/s Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] 33be960e-bb99-4d27-b762-61d6a21f3f08 was raw, converting to qcow2 {{(pid=82546) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cd6fd3-2b83-49cf-8bbf-a656ef4e5cce]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:15 devstack sudo[88657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img Apr 10 12:19:15 devstack sudo[88657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:15 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed" returned: 1 in 0.484s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Downloaded image 35717e41-b49c-4e85-9a50-2d2207b8655c ((None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}])) to volume 9e235565-9c26-467a-b7a1-9a674eb0e9ed successfully. {{(pid=82546) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Temporary image 35717e41-b49c-4e85-9a50-2d2207b8655c for user 07b0636ef85547a88e982b44e37d1419 is deleted. {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 12:19:15 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Marking volume 9e235565-9c26-467a-b7a1-9a674eb0e9ed as bootable. {{(pid=82546) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Copying metadata from image 35717e41-b49c-4e85-9a50-2d2207b8655c to 9e235565-9c26-467a-b7a1-9a674eb0e9ed. {{(pid=82546) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Creating volume glance metadata for volume 9e235565-9c26-467a-b7a1-9a674eb0e9ed backed by image 35717e41-b49c-4e85-9a50-2d2207b8655c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82546) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33d61f95-2c20-4336-936e-d0cb2b9ebd0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9c0ad9-d29c-45da-84b0-e397188968cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:16 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Volume volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed (9e235565-9c26-467a-b7a1-9a674eb0e9ed): created successfully Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b9c0ad9-d29c-45da-84b0-e397188968cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Flow 'volume_create_manager' (56b20b88-2536-4fff-8db5-b2c61910aa5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-99b1520d-6942-4fbb-9d52-46fc6f9809b0 tempest-VolumesImageMetadata-1835135326 None] Created volume successfully. Apr 10 12:19:16 devstack sudo[88657]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img" returned: 0 in 0.469s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:16 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img Apr 10 12:19:16 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:16 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img" returned: 1 in 0.458s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:19:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img /opt/stack/data/cinder/conversion/vol_upload_wb9sp_7q {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:16 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img /opt/stack/data/cinder/conversion/vol_upload_wb9sp_7q Apr 10 12:19:16 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:17 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img /opt/stack/data/cinder/conversion/vol_upload_wb9sp_7q" returned: 0 in 0.451s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Image conversion details: src /opt/stack/data/cinder/conversion/43b5eb4a-3d80-478c-a17c-8901c838760d.temp_image.33be960e-bb99-4d27-b762-61d6a21f3f08i395aaoc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wb9sp_7q {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:19:17 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c309ff8-3977-4d6c-a175-134604d80f3a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wb9sp_7q {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:17 devstack sudo[88674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wb9sp_7q Apr 10 12:19:17 devstack sudo[88674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Acquiring lock "cinder-9e235565-9c26-467a-b7a1-9a674eb0e9ed-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Lock "cinder-9e235565-9c26-467a-b7a1-9a674eb0e9ed-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Acquiring lock "cinder-quobyte-9e235565-9c26-467a-b7a1-9a674eb0e9ed" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Lock "cinder-quobyte-9e235565-9c26-467a-b7a1-9a674eb0e9ed" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce9282a-d2c1-4311-97b0-e682916d5e83]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:17 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed Apr 10 12:19:17 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:17 devstack sudo[88674]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wb9sp_7q" returned: 0 in 0.492s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:17 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:18 devstack sudo[88683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed Apr 10 12:19:18 devstack sudo[88683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:18 devstack sudo[88683]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed" returned: 1 in 0.515s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:18 devstack sudo[88688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed Apr 10 12:19:18 devstack sudo[88688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.795s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Uploaded volume to glance image-id: 33be960e-bb99-4d27-b762-61d6a21f3f08. {{(pid=82546) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.644s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1414469414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff6425cb-b58e-4834-ba9f-e187497b84ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:13Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Creating volume ff6425cb-b58e-4834-ba9f-e187497b84ef {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:18 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:18 devstack sudo[88690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef 1073741824 Apr 10 12:19:18 devstack sudo[88690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:18 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-286cc296-f38c-4692-85e0-e656203eda52 tempest-VolumesActionsTest-2131057061 None] Copy volume to image completed successfully. Apr 10 12:19:18 devstack sudo[88688]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9e235565-9c26-467a-b7a1-9a674eb0e9ed" returned: 0 in 0.499s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Lock "cinder-quobyte-9e235565-9c26-467a-b7a1-9a674eb0e9ed" released by "delete_volume" :: held 1.555s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Created reservations ['b0970b91-4ed5-4564-86a6-fd284858e834', '5e45e076-e0bb-481c-91fc-0798c5f24959', '8d9b4c42-020c-4e7f-955c-7534a9d11bbf', 'b20bbb28-6dc5-4523-839e-033ce18ea172'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:19 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:19 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:19 devstack sudo[88690]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef 1073741824" returned: 0 in 0.567s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "cinder-quobyte-43b5eb4a-3d80-478c-a17c-8901c838760d" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:19 devstack sudo[88698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef Apr 10 12:19:19 devstack sudo[88698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-quobyte-43b5eb4a-3d80-478c-a17c-8901c838760d" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30ffe04-a1f9-412c-b601-80647fa8cbd6]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:19 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:19:19 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:19 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.435s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:19 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Deleted volume successfully. Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9308907a-687b-4f8d-ae23-08fe98d58e58 tempest-VolumesImageMetadata-1835135326 None] Lock "cinder-9e235565-9c26-467a-b7a1-9a674eb0e9ed-delete_volume" released by "delete_volume" :: held 2.121s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:19 devstack sudo[88698]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef" returned: 0 in 0.425s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9827b5c4-716b-4f4b-a321-5565aaa35686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff6425cb-b58e-4834-ba9f-e187497b84ef', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f34ac7e-dcaa-41e1-bf6b-d57fe70d4d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:19 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Volume volume-ff6425cb-b58e-4834-ba9f-e187497b84ef (ff6425cb-b58e-4834-ba9f-e187497b84ef): created successfully Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f34ac7e-dcaa-41e1-bf6b-d57fe70d4d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (39628b9e-87f9-4cde-8340-24853fc4eedc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:19 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1f733adb-fc10-4b19-aaa8-46bb0d079f69 tempest-VolumesActionsTest-82281532 None] Created volume successfully. Apr 10 12:19:19 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.507s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:19 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d Apr 10 12:19:19 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-ff6425cb-b58e-4834-ba9f-e187497b84ef-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-ff6425cb-b58e-4834-ba9f-e187497b84ef-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-quobyte-ff6425cb-b58e-4834-ba9f-e187497b84ef" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:20 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-43b5eb4a-3d80-478c-a17c-8901c838760d" returned: 0 in 0.487s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-quobyte-ff6425cb-b58e-4834-ba9f-e187497b84ef" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-quobyte-43b5eb4a-3d80-478c-a17c-8901c838760d" released by "delete_volume" :: held 1.020s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d343a9b6-dd07-40dc-8def-eedf34b60646]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Created reservations ['dca3f6a5-95c9-4efd-9b57-b661648b66d6', '534c3396-afb9-4681-b6ba-7a31d4822c35', 'c765842e-e8df-4c1a-86fd-5e82aee34329', 'b2e2bc32-201e-4510-b6bb-8ec3ddd6a5d9'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:20 devstack sudo[88712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef Apr 10 12:19:20 devstack sudo[88712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:20 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:20 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:20 devstack sudo[88712]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef" returned: 0 in 0.534s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:20 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef Apr 10 12:19:20 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:20 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:20 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Deleted volume successfully. Apr 10 12:19:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0beea238-8ac6-436c-9968-b9ff98038e16 tempest-VolumesActionsTest-2131057061 None] Lock "cinder-43b5eb4a-3d80-478c-a17c-8901c838760d-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:21 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ff6425cb-b58e-4834-ba9f-e187497b84ef" returned: 0 in 0.438s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-quobyte-ff6425cb-b58e-4834-ba9f-e187497b84ef" released by "delete_volume" :: held 0.997s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Created reservations ['f1a9d470-6809-4425-a768-3782a689cbc9', 'b08378f6-4ae7-46f2-ac43-1ff39ae5691e', '76fd99a8-34de-4119-a5c7-bf5fd7b15e74', '283ae571-d385-4834-bdf8-38aa8c3cae4a'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:21 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:21 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Flow 'volume_create_manager' (b4a97d87-4f8f-4e38-b213-0c22e8f5cf4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938fc19f-505c-472b-b435-d654cabe0363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (938fc19f-505c-472b-b435-d654cabe0363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1141913192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e3952c-6885-40ec-950a-40c278018824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b0975becef42bc8a3d275986ac595f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:21Z,use_quota=True,user_id='9f29b185003849e984833d8d16b44088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4386c71b-5a11-47b1-af51-6b7ca5a34c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4386c71b-5a11-47b1-af51-6b7ca5a34c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f10b9d-1f0a-4c0e-8504-2f30b5fd907c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0f10b9d-1f0a-4c0e-8504-2f30b5fd907c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47e3952c-6885-40ec-950a-40c278018824', 'volume_name': 'volume-47e3952c-6885-40ec-950a-40c278018824', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb73908-a50e-4ce8-b389-f1952bc6064e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adb73908-a50e-4ce8-b389-f1952bc6064e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c394d-0ed5-418a-9f1d-28c2a9dcdafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:21 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Volume 47e3952c-6885-40ec-950a-40c278018824: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47e3952c-6885-40ec-950a-40c278018824', 'volume_size': 1} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1141913192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47e3952c-6885-40ec-950a-40c278018824,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38b0975becef42bc8a3d275986ac595f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:21Z,use_quota=True,user_id='9f29b185003849e984833d8d16b44088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Creating volume 47e3952c-6885-40ec-950a-40c278018824 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:21 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:21 devstack sudo[88725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 1073741824 Apr 10 12:19:21 devstack sudo[88725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:21 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.406s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Deleted volume successfully. Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-77a7ed0b-406c-429d-84e6-8340991d12d9 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-ff6425cb-b58e-4834-ba9f-e187497b84ef-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:21 devstack sudo[88725]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 1073741824" returned: 0 in 0.519s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:21 devstack sudo[88731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 Apr 10 12:19:21 devstack sudo[88731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:22 devstack sudo[88731]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824" returned: 0 in 0.490s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d8c394d-0ed5-418a-9f1d-28c2a9dcdafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47e3952c-6885-40ec-950a-40c278018824', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4d0e02-7f75-4254-9133-ddf4d7d0a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:22 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Volume volume-47e3952c-6885-40ec-950a-40c278018824 (47e3952c-6885-40ec-950a-40c278018824): created successfully Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4d0e02-7f75-4254-9133-ddf4d7d0a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Flow 'volume_create_manager' (b4a97d87-4f8f-4e38-b213-0c22e8f5cf4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:22 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-56d83316-61dc-41db-8b74-8ada3dfa6cea tempest-VolumesMetadataTest-1006924427 None] Created volume successfully. Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (c6b6446e-9fb7-41c2-ab7c-e1a84d7f784e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4c11de-27a3-45ee-8f90-ea136102c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab4c11de-27a3-45ee-8f90-ea136102c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840570439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97bafa1-72e1-4b58-b6f7-a95f6d07208a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:23Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6517b4d6-3c9b-4eb8-8bbb-4d45fb8a1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6517b4d6-3c9b-4eb8-8bbb-4d45fb8a1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfb8776-59a5-4909-b3c7-9b0d9657a79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cfb8776-59a5-4909-b3c7-9b0d9657a79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e97bafa1-72e1-4b58-b6f7-a95f6d07208a', 'volume_name': 'volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cd7f0d-5571-4cb0-b6d7-323100a41792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2cd7f0d-5571-4cb0-b6d7-323100a41792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2afde11-4c40-4657-ae7f-c8bcfa6db715) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:22 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Volume e97bafa1-72e1-4b58-b6f7-a95f6d07208a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a', 'volume_size': 1} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1840570439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e97bafa1-72e1-4b58-b6f7-a95f6d07208a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:23Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Creating volume e97bafa1-72e1-4b58-b6f7-a95f6d07208a {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:22 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:22 devstack sudo[88735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a 1073741824 Apr 10 12:19:22 devstack sudo[88735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:23 devstack sudo[88735]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a 1073741824" returned: 0 in 0.578s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:23 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a Apr 10 12:19:23 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:23 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2afde11-4c40-4657-ae7f-c8bcfa6db715) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408944ad-3850-47c6-8753-97eb0ee89056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:23 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Volume volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a (e97bafa1-72e1-4b58-b6f7-a95f6d07208a): created successfully Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (408944ad-3850-47c6-8753-97eb0ee89056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (c6b6446e-9fb7-41c2-ab7c-e1a84d7f784e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:23 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-bc652d06-f723-4d85-92ae-08b848e82fa8 tempest-VolumesActionsTest-82281532 None] Created volume successfully. Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Acquiring lock "cinder-47e3952c-6885-40ec-950a-40c278018824-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Lock "cinder-47e3952c-6885-40ec-950a-40c278018824-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Acquiring lock "cinder-quobyte-47e3952c-6885-40ec-950a-40c278018824" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Lock "cinder-quobyte-47e3952c-6885-40ec-950a-40c278018824" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed110e9-6055-48bb-a1dd-abd93d7aa54c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:24 devstack sudo[88745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 Apr 10 12:19:24 devstack sudo[88745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:24 devstack sudo[88745]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824" returned: 0 in 0.498s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:24 devstack sudo[88750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824 Apr 10 12:19:24 devstack sudo[88750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-e97bafa1-72e1-4b58-b6f7-a95f6d07208a-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-e97bafa1-72e1-4b58-b6f7-a95f6d07208a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-quobyte-e97bafa1-72e1-4b58-b6f7-a95f6d07208a" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-quobyte-e97bafa1-72e1-4b58-b6f7-a95f6d07208a" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[497f114b-7725-4c4d-bd09-b353e1ca4a4c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:24 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a Apr 10 12:19:24 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:25 devstack sudo[88750]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47e3952c-6885-40ec-950a-40c278018824" returned: 0 in 0.565s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Lock "cinder-quobyte-47e3952c-6885-40ec-950a-40c278018824" released by "delete_volume" :: held 1.106s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Created reservations ['27d4d281-d07c-46a8-b1c1-1bef381b544c', 'd40b630f-e8c5-4ecd-b821-60a179b1a2c5', 'dfdf54d0-46a4-4ef1-afe6-00670d2a929e', '94fc80af-b84a-41dc-8518-8997cbd6ae3c'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:25 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:25 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Flow 'volume_create_manager' (eea73f34-2613-4468-af75-50851f6fa255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f39d8ed-bbeb-4da7-afb9-a3d56746e89a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f39d8ed-bbeb-4da7-afb9-a3d56746e89a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1263937561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843ac1bb-f313-46e8-8ad3-76421b7b8e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3934edfbc98f429588157028bb8a05a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:25Z,use_quota=True,user_id='5935ad71379e4c189f8d179f2d861d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3691da-81fa-4c2d-8744-c28469673b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3691da-81fa-4c2d-8744-c28469673b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cb426f-2471-462f-a250-52a0e13931ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84cb426f-2471-462f-a250-52a0e13931ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '843ac1bb-f313-46e8-8ad3-76421b7b8e43', 'volume_name': 'volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43', 'volume_size': 2}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813816da-8aa8-4355-8da3-b7e5b101208f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (813816da-8aa8-4355-8da3-b7e5b101208f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed77bfd-20e2-4381-bffa-4d5a7572cf7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:25 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Volume 843ac1bb-f313-46e8-8ad3-76421b7b8e43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43', 'volume_size': 2} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1263937561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=843ac1bb-f313-46e8-8ad3-76421b7b8e43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3934edfbc98f429588157028bb8a05a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:25Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:25Z,use_quota=True,user_id='5935ad71379e4c189f8d179f2d861d4f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Creating volume 843ac1bb-f313-46e8-8ad3-76421b7b8e43 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:25 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 2147483648 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:25 devstack sudo[88760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 2147483648 Apr 10 12:19:25 devstack sudo[88760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:25 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a" returned: 0 in 0.525s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:25 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a Apr 10 12:19:25 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:25 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.416s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:25 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Deleted volume successfully. Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f0516138-5ac3-4f6b-8397-283f94b250e6 tempest-VolumesMetadataTest-1006924427 None] Lock "cinder-47e3952c-6885-40ec-950a-40c278018824-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:25 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e97bafa1-72e1-4b58-b6f7-a95f6d07208a" returned: 0 in 0.436s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:25 devstack sudo[88760]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 2147483648" returned: 0 in 0.498s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-quobyte-e97bafa1-72e1-4b58-b6f7-a95f6d07208a" released by "delete_volume" :: held 0.986s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:25 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 Apr 10 12:19:25 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Created reservations ['0ee832f4-7b0e-4359-9942-e66d45c4b0ae', 'd03f10d2-91c1-46f8-a747-c66ac6b6d1f7', 'c8ba7967-9875-4f2b-93c3-7fede36ebd95', 'f5b5ea4e-e029-4ac2-a8a1-534849dd3baf'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:25 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:25 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:26 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43" returned: 0 in 0.411s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bed77bfd-20e2-4381-bffa-4d5a7572cf7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43', 'volume_size': 2}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7087bee9-73e9-44bc-98c1-227a17a213ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:26 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Volume volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 (843ac1bb-f313-46e8-8ad3-76421b7b8e43): created successfully Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7087bee9-73e9-44bc-98c1-227a17a213ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Flow 'volume_create_manager' (eea73f34-2613-4468-af75-50851f6fa255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:26 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-85085762-6911-47ae-a4c4-6bef0c0bde08 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Created volume successfully. Apr 10 12:19:26 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.444s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:26 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Deleted volume successfully. Apr 10 12:19:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-97730df0-c0d7-4b35-a9d9-2d292ae53b70 tempest-VolumesActionsTest-1349652478 None] Lock "cinder-e97bafa1-72e1-4b58-b6f7-a95f6d07208a-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (d69b6535-6638-4756-a394-9ec80566a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4f3b9e-7465-4e6b-9ff3-9cd627886df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4f3b9e-7465-4e6b-9ff3-9cd627886df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156597630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321aa8a9-0707-439b-bdf9-2dfe16dc3784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:27Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d49bba-159a-40b4-9393-80ec2b27e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d49bba-159a-40b4-9393-80ec2b27e832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68436d80-98f4-49f8-a571-5de47918a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68436d80-98f4-49f8-a571-5de47918a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321aa8a9-0707-439b-bdf9-2dfe16dc3784', 'volume_name': 'volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a85fb3-4aab-41a8-a4c2-ec410e297937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32a85fb3-4aab-41a8-a4c2-ec410e297937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e35d771-624d-4b43-97bd-96fefe6e1847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Volume 321aa8a9-0707-439b-bdf9-2dfe16dc3784: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784', 'volume_size': 1} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1156597630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321aa8a9-0707-439b-bdf9-2dfe16dc3784,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:27Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Creating volume 321aa8a9-0707-439b-bdf9-2dfe16dc3784 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:27 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:27 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 1073741824 Apr 10 12:19:27 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:27 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 1073741824" returned: 0 in 0.532s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:27 devstack sudo[88780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 Apr 10 12:19:27 devstack sudo[88780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Flow 'volume_create_manager' (0fcb56e8-cba2-4f85-a6ec-99acaf271ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6bd1cf-30a1-45dc-b03a-c3109ba2ffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6bd1cf-30a1-45dc-b03a-c3109ba2ffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1698712095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafacb18-4880-4d54-8a13-14767342af3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b73069b26f4af6a97504820cba2d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:28Z,use_quota=True,user_id='38981fbcbd1b4e2d89dedd997837e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba8cf5e-7be5-4d88-a99c-b5560d6edf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ba8cf5e-7be5-4d88-a99c-b5560d6edf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcee10e-ddcb-4e17-8b56-9d673eb3d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dcee10e-ddcb-4e17-8b56-9d673eb3d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eafacb18-4880-4d54-8a13-14767342af3c', 'volume_name': 'volume-eafacb18-4880-4d54-8a13-14767342af3c', 'volume_size': 2}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837af700-4edc-43f3-a936-993ec993e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (837af700-4edc-43f3-a936-993ec993e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6decd04-7ee5-4667-93c1-58a690030d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:28 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Volume eafacb18-4880-4d54-8a13-14767342af3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eafacb18-4880-4d54-8a13-14767342af3c', 'volume_size': 2} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:28 devstack sudo[88780]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784" returned: 0 in 0.423s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.749s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e35d771-624d-4b43-97bd-96fefe6e1847) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d56a59a-587a-4610-8a19-504cc1abc11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:28 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Volume volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 (321aa8a9-0707-439b-bdf9-2dfe16dc3784): created successfully Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d56a59a-587a-4610-8a19-504cc1abc11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (d69b6535-6638-4756-a394-9ec80566a336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Creating offline snapshot 2b70d1bc-ee4e-4716-8705-6abaf60722a6 of volume 843ac1bb-f313-46e8-8ad3-76421b7b8e43 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:19:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-00bf261e-74b9-4a40-8027-72822cee5e41 tempest-VolumesActionsTest-82281532 None] Created volume successfully. Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0384e461-07ab-4a5d-a45d-86b87d56d0b9]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:28 devstack sudo[88783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 Apr 10 12:19:28 devstack sudo[88783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:28 devstack sudo[88783]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43" returned: 0 in 0.470s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 2G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:28 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 2G Apr 10 12:19:28 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:29 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 2G" returned: 0 in 0.489s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:29 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 Apr 10 12:19:29 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-321aa8a9-0707-439b-bdf9-2dfe16dc3784-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Lock "cinder-321aa8a9-0707-439b-bdf9-2dfe16dc3784-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Acquiring lock "cinder-quobyte-321aa8a9-0707-439b-bdf9-2dfe16dc3784" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Lock "cinder-quobyte-321aa8a9-0707-439b-bdf9-2dfe16dc3784" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28e9e81-f173-4b16-9e8e-d7f6cb697e9a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:29 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 Apr 10 12:19:29 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:29 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:29 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 is being set with open permissions: ugo+rw Apr 10 12:19:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:29 devstack sudo[88800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 Apr 10 12:19:29 devstack sudo[88800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:30 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784" returned: 0 in 0.471s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:30 devstack sudo[88805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784 Apr 10 12:19:30 devstack sudo[88805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:30 devstack sudo[88800]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6" returned: 0 in 0.424s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:30 devstack sudo[88808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.info Apr 10 12:19:30 devstack sudo[88808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:30 devstack sudo[88805]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-321aa8a9-0707-439b-bdf9-2dfe16dc3784" returned: 0 in 0.415s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Lock "cinder-quobyte-321aa8a9-0707-439b-bdf9-2dfe16dc3784" released by "delete_volume" :: held 0.906s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Created reservations ['858a0e93-b1d8-4045-bc4c-395f013e8d59', 'daab1804-a8dc-40f3-b520-758544c58d9a', '66509b1f-adaa-4178-812d-1c23980a35ee', 'c875ad88-92fb-4cfe-8f6f-2139dca50133'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:30 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:30 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:30 devstack sudo[88808]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.info" returned: 0 in 0.467s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:30 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.info is being set with open permissions: ugo+rw Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:30 devstack sudo[88814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.info Apr 10 12:19:30 devstack sudo[88814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (b3901b48-48a7-4984-a3c0-b3f766fb55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3d6240-31b5-4ee0-8576-caa635bbd3d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de3d6240-31b5-4ee0-8576-caa635bbd3d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1574883301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fbbe64-2eb7-4354-9f6d-224711a5ef91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:31Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6227859c-1900-45d1-b67c-75efd573d831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6227859c-1900-45d1-b67c-75efd573d831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce19525c-d8e0-4917-b9c7-5eb01fea114f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce19525c-d8e0-4917-b9c7-5eb01fea114f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9fbbe64-2eb7-4354-9f6d-224711a5ef91', 'volume_name': 'volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c8de84-787b-4652-bed0-73c6400e36e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c8de84-787b-4652-bed0-73c6400e36e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8043ab27-acd3-44fb-8a5d-b21da9ea3a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:30 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Volume f9fbbe64-2eb7-4354-9f6d-224711a5ef91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91', 'volume_size': 1} Apr 10 12:19:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:31 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.520s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Deleted volume successfully. Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f5b4e817-30cf-4291-a1ce-64e15f04258b tempest-VolumesActionsTest-1349652478 None] Lock "cinder-321aa8a9-0707-439b-bdf9-2dfe16dc3784-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:31 devstack sudo[88814]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.info" returned: 0 in 0.439s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.838s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.181s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1698712095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eafacb18-4880-4d54-8a13-14767342af3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87b73069b26f4af6a97504820cba2d53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:28Z,use_quota=True,user_id='38981fbcbd1b4e2d89dedd997837e420',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Creating volume eafacb18-4880-4d54-8a13-14767342af3c {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:31 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c 2147483648 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:31 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c 2147483648 Apr 10 12:19:31 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a58bbea8-f7aa-46d0-8cab-1810d1c849f0 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Create snapshot completed successfully Apr 10 12:19:31 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c 2147483648" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:31 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c Apr 10 12:19:31 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "cinder-2b70d1bc-ee4e-4716-8705-6abaf60722a6-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-2b70d1bc-ee4e-4716-8705-6abaf60722a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "cinder-quobyte-843ac1bb-f313-46e8-8ad3-76421b7b8e43" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-quobyte-843ac1bb-f313-46e8-8ad3-76421b7b8e43" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "cinder-quobyte-2b70d1bc-ee4e-4716-8705-6abaf60722a6" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-quobyte-2b70d1bc-ee4e-4716-8705-6abaf60722a6" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Deleting offline snapshot 2b70d1bc-ee4e-4716-8705-6abaf60722a6 of volume 843ac1bb-f313-46e8-8ad3-76421b7b8e43 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] snapshot_file for this snap is: volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a59d70f-8fb8-48a9-bce7-a411c4d1380e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:31 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 Apr 10 12:19:31 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:32 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c" returned: 0 in 0.449s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.201s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1574883301',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9fbbe64-2eb7-4354-9f6d-224711a5ef91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='914614f316c3488493e88cdd55a98ca9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:31Z,use_quota=True,user_id='16f93d84d59e4c35acbd5946485ffeed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Creating volume f9fbbe64-2eb7-4354-9f6d-224711a5ef91 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:32 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6decd04-7ee5-4667-93c1-58a690030d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eafacb18-4880-4d54-8a13-14767342af3c', 'volume_size': 2}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d415794d-b42b-4f95-8400-f29b27bef700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:32 devstack sudo[88828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 1073741824 Apr 10 12:19:32 devstack sudo[88828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:32 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Volume volume-eafacb18-4880-4d54-8a13-14767342af3c (eafacb18-4880-4d54-8a13-14767342af3c): created successfully Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d415794d-b42b-4f95-8400-f29b27bef700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Flow 'volume_create_manager' (0fcb56e8-cba2-4f85-a6ec-99acaf271ccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:32 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-13a6c9ed-72eb-423f-9a93-181cfcc0f076 tempest-VolumesCloneNegativeTest-2082532122 None] Created volume successfully. Apr 10 12:19:32 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6" returned: 0 in 0.494s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4196c5-511f-4bca-9d5e-fc11bae0074b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:32 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 Apr 10 12:19:32 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:32 devstack sudo[88828]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 1073741824" returned: 0 in 0.474s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:32 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 Apr 10 12:19:32 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:32 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43" returned: 0 in 0.484s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:32 devstack sudo[88843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 Apr 10 12:19:32 devstack sudo[88843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:33 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91" returned: 0 in 0.421s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8043ab27-acd3-44fb-8a5d-b21da9ea3a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63a5e21-4dfe-4915-854a-dfed06cc602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:33 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Volume volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 (f9fbbe64-2eb7-4354-9f6d-224711a5ef91): created successfully Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b63a5e21-4dfe-4915-854a-dfed06cc602f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Flow 'volume_create_manager' (b3901b48-48a7-4984-a3c0-b3f766fb55d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:33 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3f3aae74-bb1f-4c88-8847-6dc478a058cb tempest-VolumesActionsTest-82281532 None] Created volume successfully. Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Acquiring lock "cinder-eafacb18-4880-4d54-8a13-14767342af3c-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "cinder-eafacb18-4880-4d54-8a13-14767342af3c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:33 devstack sudo[88843]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:33 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6 Apr 10 12:19:33 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Acquiring lock "cinder-quobyte-eafacb18-4880-4d54-8a13-14767342af3c" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "cinder-quobyte-eafacb18-4880-4d54-8a13-14767342af3c" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d34c78b0-64ca-4575-a543-9d2160a801b8]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:33 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c Apr 10 12:19:33 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:33 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43.2b70d1bc-ee4e-4716-8705-6abaf60722a6" returned: 0 in 0.408s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-quobyte-2b70d1bc-ee4e-4716-8705-6abaf60722a6" released by "_delete_snapshot" :: held 1.925s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-quobyte-843ac1bb-f313-46e8-8ad3-76421b7b8e43" released by "delete_snapshot" :: held 1.935s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Created reservations ['3b574931-d2fb-4f85-bd56-0538130c5657', '9467dec8-e955-42c3-9821-1cfe9e2d13e6', '8a02ce8c-067f-4ad8-8cbe-ba41e5538c3e', '6f818b8f-6c88-44f4-827a-7c23d2b652cd'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:33 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Delete snapshot completed successfully. Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8c99f474-9475-4927-bcb3-50a00001bd7c tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-2b70d1bc-ee4e-4716-8705-6abaf60722a6-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:33 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:33 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c Apr 10 12:19:33 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "cinder-843ac1bb-f313-46e8-8ad3-76421b7b8e43-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-843ac1bb-f313-46e8-8ad3-76421b7b8e43-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "cinder-quobyte-843ac1bb-f313-46e8-8ad3-76421b7b8e43" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-quobyte-843ac1bb-f313-46e8-8ad3-76421b7b8e43" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6e3bd7-dbc2-4e21-9ef9-b59cc5a43108]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:34 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 Apr 10 12:19:34 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:34 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-eafacb18-4880-4d54-8a13-14767342af3c" returned: 0 in 0.463s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "cinder-quobyte-eafacb18-4880-4d54-8a13-14767342af3c" released by "delete_volume" :: held 0.962s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Created reservations ['38135bd2-2acc-41e3-9271-a7c96583f0a1', '3c6b20ed-bc88-472c-b72f-ffe559edc2a4', '4eb26947-1794-4dce-8a2f-b2478066cd99', 'ae7e1cdf-183e-45f5-9800-9b75ea1887a7'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:34 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:34 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Acquiring lock "cinder-f9fbbe64-2eb7-4354-9f6d-224711a5ef91-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Lock "cinder-f9fbbe64-2eb7-4354-9f6d-224711a5ef91-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:34 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43" returned: 0 in 0.549s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Acquiring lock "cinder-quobyte-f9fbbe64-2eb7-4354-9f6d-224711a5ef91" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:34 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43 Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Lock "cinder-quobyte-f9fbbe64-2eb7-4354-9f6d-224711a5ef91" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:34 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[181cd74e-7869-4740-87c4-d3de2b670c82]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:34 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 Apr 10 12:19:34 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:34 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:34 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Deleted volume successfully. Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f3b91a4d-e5da-4e72-a585-751fcb103ec9 tempest-VolumesCloneNegativeTest-2082532122 None] Lock "cinder-eafacb18-4880-4d54-8a13-14767342af3c-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:34 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-843ac1bb-f313-46e8-8ad3-76421b7b8e43" returned: 0 in 0.431s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-quobyte-843ac1bb-f313-46e8-8ad3-76421b7b8e43" released by "delete_volume" :: held 1.025s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Created reservations ['38ffee30-2601-4c3f-829b-8ccbfcf26ea0', '850fd10d-71ed-4079-b4ef-ea53de72f086', '1ce3e2c7-e0ef-4a86-90c4-520429cef5d0', 'fce25996-de0c-4a50-a4c0-4cf763e3a76d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:35 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:35 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:35 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:35 devstack sudo[88879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91 Apr 10 12:19:35 devstack sudo[88879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:35 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.411s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:35 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Deleted volume successfully. Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=130,cinder:INSERT=52,cinder:UPDATE=178,cinder:DELETE=16 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b50e7c9-e39a-4d3a-a805-657d07e864c1 tempest-VolumesSnapshotNegativeTestJSON-718903876 None] Lock "cinder-843ac1bb-f313-46e8-8ad3-76421b7b8e43-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:35 devstack sudo[88879]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f9fbbe64-2eb7-4354-9f6d-224711a5ef91" returned: 0 in 0.437s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Lock "cinder-quobyte-f9fbbe64-2eb7-4354-9f6d-224711a5ef91" released by "delete_volume" :: held 0.962s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:UPDATE=133,cinder:SELECT=128,cinder:INSERT=35,cinder:DELETE=10 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Created reservations ['2fc447e4-f571-40e4-83d5-eb40e5ad2f9e', '63649425-5884-47cf-8d9a-c137e41e238e', '148c8ae2-c419-475e-b636-6d4e66c9881c', '74d2c023-f3d7-4297-a098-f73a18b63dac'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:35 devstack sudo[88883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:35 devstack sudo[88883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:36 devstack sudo[88883]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.430s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:36 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:36 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Deleted volume successfully. Apr 10 12:19:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-14a2da7f-f83a-4a84-ad5d-57aecdebebb9 tempest-VolumesActionsTest-82281532 None] Lock "cinder-f9fbbe64-2eb7-4354-9f6d-224711a5ef91-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:37 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Flow 'volume_create_manager' (ab5f1a8a-25cb-43f2-9fc3-a4f71c585a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbcf187-d3ce-412b-a0fa-3270d54442fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbcf187-d3ce-412b-a0fa-3270d54442fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-916747384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67559416-439a-4655-b663-e344b829b676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d6f3ec493d4af1ab8fc5a3705d391d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:38Z,use_quota=True,user_id='90a02fafc3a746fdaed53c6cd499ecc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a0295e-4470-4aa8-a88d-ab772d794a5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45a0295e-4470-4aa8-a88d-ab772d794a5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:37 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41134f21-1004-40ad-8289-26cf9346b1b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:37 devstack cinder-volume[82546]: DEBUG cinder.image.glance [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Creating Keystone auth plugin from conf {{(pid=82546) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41134f21-1004-40ad-8289-26cf9346b1b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '67559416-439a-4655-b663-e344b829b676', 'volume_name': 'volume-67559416-439a-4655-b663-e344b829b676', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36160e3b-652e-4ce3-b028-964d673ab944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36160e3b-652e-4ce3-b028-964d673ab944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a76b44-5be7-49f1-92f1-a5260046101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:38 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Volume 67559416-439a-4655-b663-e344b829b676: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-67559416-439a-4655-b663-e344b829b676', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Trying to clone 67559416-439a-4655-b663-e344b829b676 from image 35717e41-b49c-4e85-9a50-2d2207b8655c at location (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]). {{(pid=82546) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (46306cf8-89f1-45b7-86aa-197a0e39c652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1576de1e-9ea5-487c-a999-074d11d1683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1576de1e-9ea5-487c-a999-074d11d1683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752470932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad02003-3a60-4590-9b32-4d40f66c8d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:38Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91680a6-cab6-458f-89da-ebd3b1df05c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f91680a6-cab6-458f-89da-ebd3b1df05c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb92493-80de-4dc3-9798-3e7f1d9e0ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfb92493-80de-4dc3-9798-3e7f1d9e0ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad02003-3a60-4590-9b32-4d40f66c8d03', 'volume_name': 'volume-7ad02003-3a60-4590-9b32-4d40f66c8d03', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11515e49-7659-4509-8b43-f4df94c4c729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11515e49-7659-4509-8b43-f4df94c4c729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e254e4-ae63-456e-9bf9-2a9178431d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:38 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume 7ad02003-3a60-4590-9b32-4d40f66c8d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad02003-3a60-4590-9b32-4d40f66c8d03', 'volume_size': 1} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-752470932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad02003-3a60-4590-9b32-4d40f66c8d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:38Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Creating volume 7ad02003-3a60-4590-9b32-4d40f66c8d03 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:38 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:38 devstack sudo[88888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 1073741824 Apr 10 12:19:38 devstack sudo[88888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 12:19:38 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Image download 20.69 MB at 20.69 MB/s Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7761bfb1-476a-42cc-99b6-4c2aafed9d50]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:38 devstack sudo[88891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD Apr 10 12:19:38 devstack sudo[88891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:38 devstack sudo[88888]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 1073741824" returned: 0 in 0.554s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:38 devstack sudo[88896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 Apr 10 12:19:38 devstack sudo[88896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:39 devstack sudo[88891]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD" returned: 0 in 0.650s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Temporary image 35717e41-b49c-4e85-9a50-2d2207b8655c is fetched for user 90a02fafc3a746fdaed53c6cd499ecc7. {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e57572e-0d93-4668-acbe-373076215aae]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:39 devstack sudo[88901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD Apr 10 12:19:39 devstack sudo[88901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:39 devstack sudo[88896]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03" returned: 0 in 0.471s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48e254e4-ae63-456e-9bf9-2a9178431d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad02003-3a60-4590-9b32-4d40f66c8d03', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05baf03d-713e-4a44-be57-694c872be63f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:39 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 (7ad02003-3a60-4590-9b32-4d40f66c8d03): created successfully Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05baf03d-713e-4a44-be57-694c872be63f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (46306cf8-89f1-45b7-86aa-197a0e39c652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:39 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-37fc433e-f774-4fbe-946a-d284ea841a3d tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created volume successfully. Apr 10 12:19:39 devstack sudo[88901]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD" returned: 0 in 0.562s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-916747384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67559416-439a-4655-b663-e344b829b676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d6f3ec493d4af1ab8fc5a3705d391d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:38Z,use_quota=True,user_id='90a02fafc3a746fdaed53c6cd499ecc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Creating volume 67559416-439a-4655-b663-e344b829b676 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:39 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:39 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 1073741824 Apr 10 12:19:39 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:40 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 1073741824" returned: 0 in 0.531s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:40 devstack sudo[88913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:40 devstack sudo[88913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (9a00ca87-cb55-456d-bb34-9cba19860276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d0e913-6e38-4560-a453-96c29d2b0f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8d0e913-6e38-4560-a453-96c29d2b0f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1582568034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a54e361-3017-4352-ab86-08ef494bfe56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:40Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff2dff6-d2d8-436d-b004-091bfbfdde42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cff2dff6-d2d8-436d-b004-091bfbfdde42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06078c8-77e1-410d-8402-51b6b13c985b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c06078c8-77e1-410d-8402-51b6b13c985b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a54e361-3017-4352-ab86-08ef494bfe56', 'volume_name': 'volume-8a54e361-3017-4352-ab86-08ef494bfe56', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c29a44f-dede-451d-ab5a-c68cda2aaf48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c29a44f-dede-451d-ab5a-c68cda2aaf48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726361bf-a5b2-4ec5-bb71-57139182088b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume 8a54e361-3017-4352-ab86-08ef494bfe56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a54e361-3017-4352-ab86-08ef494bfe56', 'volume_size': 1} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (4e06f587-6856-46ce-886a-5dba27b2314c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b260bbd2-187c-45f7-9eac-2e5d155ffaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b260bbd2-187c-45f7-9eac-2e5d155ffaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215762068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc7c3b7-452a-4e91-a6a6-74e74932b701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:41Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f4ba88-9d35-4fbf-bf33-d343f8ad2a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6f4ba88-9d35-4fbf-bf33-d343f8ad2a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ba02aa-4131-45d4-9e49-c2770e9a8fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9ba02aa-4131-45d4-9e49-c2770e9a8fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bc7c3b7-452a-4e91-a6a6-74e74932b701', 'volume_name': 'volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a0f27c-447a-4525-9017-02eaa44fa303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a0f27c-447a-4525-9017-02eaa44fa303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e996e59d-691e-40c1-bbc9-4cb0cbf19d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:40 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume 4bc7c3b7-452a-4e91-a6a6-74e74932b701: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701', 'volume_size': 1} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:40 devstack sudo[88913]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 0 in 0.568s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.206s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1582568034',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a54e361-3017-4352-ab86-08ef494bfe56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:40Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Creating volume 8a54e361-3017-4352-ab86-08ef494bfe56 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:40 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Attempting download of 35717e41-b49c-4e85-9a50-2d2207b8655c ((None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}])) to volume 67559416-439a-4655-b663-e344b829b676. {{(pid=82546) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 12:19:40 devstack sudo[88917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 1073741824 Apr 10 12:19:40 devstack sudo[88917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e792f104-42a2-4629-8b91-a04fba97ca12]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_kgqtau34 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:40 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (41c8c7a6-9bed-470d-bbbb-08085e727097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a32e226-6b0e-4e1c-bfca-a3a6e74b426e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_kgqtau34 Apr 10 12:19:41 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a32e226-6b0e-4e1c-bfca-a3a6e74b426e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-161211360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f229266b-f062-47c1-a415-d1157ad3223b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:41Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c76583d-8215-444e-9c3f-6841606fb0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c76583d-8215-444e-9c3f-6841606fb0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad69ea6-d622-49c4-a010-1b96dd5a4bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bad69ea6-d622-49c4-a010-1b96dd5a4bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f229266b-f062-47c1-a415-d1157ad3223b', 'volume_name': 'volume-f229266b-f062-47c1-a415-d1157ad3223b', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051c829f-7c96-41e0-b963-bc2698d24e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (051c829f-7c96-41e0-b963-bc2698d24e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091efb61-d601-41b4-87e4-19ef048b99a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume f229266b-f062-47c1-a415-d1157ad3223b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f229266b-f062-47c1-a415-d1157ad3223b', 'volume_size': 1} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (5741036c-1360-44b7-b1b0-19306959d9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1afaae-7cbd-46a7-b84b-df575ed75d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f1afaae-7cbd-46a7-b84b-df575ed75d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431264155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237ac1f7-97c7-4062-8fb1-e7929b1d0011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:41Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52cea6d-534e-4984-be25-fa210bf1512d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b52cea6d-534e-4984-be25-fa210bf1512d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507dadc5-d556-4d8c-942f-8acb02db1c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507dadc5-d556-4d8c-942f-8acb02db1c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '237ac1f7-97c7-4062-8fb1-e7929b1d0011', 'volume_name': 'volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6476d74a-04ec-4dd3-8d6d-2903c6b0f6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6476d74a-04ec-4dd3-8d6d-2903c6b0f6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c74164c-f5cc-4e21-bba6-b68af88095db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume 237ac1f7-97c7-4062-8fb1-e7929b1d0011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011', 'volume_size': 1} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (05842bf3-e103-4df7-b61f-4a69f1708ee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af529f20-3269-484b-82e2-8b96635dd292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af529f20-3269-484b-82e2-8b96635dd292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799799509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497fa008-1188-407c-a440-eab216b0a256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:41Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be367e2-bd5d-4725-9ad4-cd451baa9a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4be367e2-bd5d-4725-9ad4-cd451baa9a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae26856-4829-41d6-bf61-cdade634078a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ae26856-4829-41d6-bf61-cdade634078a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '497fa008-1188-407c-a440-eab216b0a256', 'volume_name': 'volume-497fa008-1188-407c-a440-eab216b0a256', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07116cf0-eda8-4471-bb0d-bbb1b8df0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack sudo[88917]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07116cf0-eda8-4471-bb0d-bbb1b8df0454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9cfa79-ad01-44bb-87c3-92bc95621cbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume 497fa008-1188-407c-a440-eab216b0a256: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-497fa008-1188-407c-a440-eab216b0a256', 'volume_size': 1} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 1073741824" returned: 0 in 0.658s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:41 devstack sudo[88926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 Apr 10 12:19:41 devstack sudo[88926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:41 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_kgqtau34" returned: 0 in 0.697s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_kgqtau34 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:41 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_kgqtau34 Apr 10 12:19:41 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:41 devstack sudo[88926]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] <== create_volume: return (1181ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.214s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-215762068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bc7c3b7-452a-4e91-a6a6-74e74932b701,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:41Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Creating volume 4bc7c3b7-452a-4e91-a6a6-74e74932b701 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:42 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (726361bf-a5b2-4ec5-bb71-57139182088b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a54e361-3017-4352-ab86-08ef494bfe56', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:42 devstack sudo[88931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 1073741824 Apr 10 12:19:42 devstack sudo[88931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a407eca-5772-4803-849c-2af2429e8a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:42 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume volume-8a54e361-3017-4352-ab86-08ef494bfe56 (8a54e361-3017-4352-ab86-08ef494bfe56): created successfully Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a407eca-5772-4803-849c-2af2429e8a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (9a00ca87-cb55-456d-bb34-9cba19860276) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:42 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-76121bc2-36d5-4447-b7b5-3bd90b67f446 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created volume successfully. Apr 10 12:19:42 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_kgqtau34" returned: 1 in 0.571s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_kgqtau34' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e0e551-da78-4930-9eee-c2de7a4563cb]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:42 devstack sudo[88935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD Apr 10 12:19:42 devstack sudo[88935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:42 devstack sudo[88931]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 1073741824" returned: 0 in 0.538s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:42 devstack sudo[88941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 Apr 10 12:19:42 devstack sudo[88941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:42 devstack sudo[88935]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD" returned: 0 in 0.588s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] 35717e41-b49c-4e85-9a50-2d2207b8655c was qcow2, converting to raw {{(pid=82546) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 12:19:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:42 devstack sudo[88946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:42 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:43 devstack sudo[88941]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] <== create_volume: return (1062ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.065s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.997s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-161211360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f229266b-f062-47c1-a415-d1157ad3223b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:41Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Creating volume f229266b-f062-47c1-a415-d1157ad3223b {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:43 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e996e59d-691e-40c1-bbc9-4cb0cbf19d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69d3def-05e1-4f9e-a949-070d78daa937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:43 devstack sudo[88949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b 1073741824 Apr 10 12:19:43 devstack sudo[88949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:43 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 (4bc7c3b7-452a-4e91-a6a6-74e74932b701): created successfully Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69d3def-05e1-4f9e-a949-070d78daa937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (4e06f587-6856-46ce-886a-5dba27b2314c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:43 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-5ea67b72-3395-4b14-941e-7d3281f4a188 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created volume successfully. Apr 10 12:19:43 devstack sudo[88949]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b 1073741824" returned: 0 in 0.574s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:43 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b Apr 10 12:19:43 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:43 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 0 in 1.057s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_h22fjvy_devstack@QuobyteHD, size 112.00 MB, duration 1.06 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:19:43 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Converted 112.00 MB image at 105.66 MB/s Apr 10 12:19:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:43 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 1G Apr 10 12:19:43 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:44 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.919s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-431264155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=237ac1f7-97c7-4062-8fb1-e7929b1d0011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:41Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Creating volume 237ac1f7-97c7-4062-8fb1-e7929b1d0011 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:44 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (091efb61-d601-41b4-87e4-19ef048b99a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f229266b-f062-47c1-a415-d1157ad3223b', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a72f27-d746-4e88-9187-4b334d6d85ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:44 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume volume-f229266b-f062-47c1-a415-d1157ad3223b (f229266b-f062-47c1-a415-d1157ad3223b): created successfully Apr 10 12:19:44 devstack sudo[88982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 1073741824 Apr 10 12:19:44 devstack sudo[88982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93a72f27-d746-4e88-9187-4b334d6d85ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (41c8c7a6-9bed-470d-bbbb-08085e727097) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:44 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ce73bc2e-e259-4dfb-acb5-9038fe6984b8 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created volume successfully. Apr 10 12:19:44 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 1G" returned: 0 in 0.462s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[748685ed-cd04-4899-8fe3-04192522ad72]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:44 devstack sudo[88986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:44 devstack sudo[88986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:44 devstack sudo[88982]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 1073741824" returned: 0 in 0.579s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:44 devstack sudo[88993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 Apr 10 12:19:44 devstack sudo[88993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:44 devstack sudo[88986]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 0 in 0.538s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:44 devstack sudo[88995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:44 devstack sudo[88995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:45 devstack sudo[88993]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011" returned: 0 in 0.467s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.778s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-799799509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=497fa008-1188-407c-a440-eab216b0a256,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b81b6510cc148c49256a7bf1b002a22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:41Z,use_quota=True,user_id='8faea737fb9a42e8b0ac9d176cbd0e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Creating volume 497fa008-1188-407c-a440-eab216b0a256 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:45 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c74164c-f5cc-4e21-bba6-b68af88095db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6718a8e9-0de8-4b05-8144-f38a06dc6340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:45 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 1073741824 Apr 10 12:19:45 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:45 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 (237ac1f7-97c7-4062-8fb1-e7929b1d0011): created successfully Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6718a8e9-0de8-4b05-8144-f38a06dc6340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (5741036c-1360-44b7-b1b0-19306959d9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:45 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-efff9fb1-f087-4539-9185-6ebbb9952b1b tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created volume successfully. Apr 10 12:19:45 devstack sudo[88995]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 1 in 0.628s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Downloaded image 35717e41-b49c-4e85-9a50-2d2207b8655c ((None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}])) to volume 67559416-439a-4655-b663-e344b829b676 successfully. {{(pid=82546) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Temporary image 35717e41-b49c-4e85-9a50-2d2207b8655c for user 90a02fafc3a746fdaed53c6cd499ecc7 is deleted. {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Marking volume 67559416-439a-4655-b663-e344b829b676 as bootable. {{(pid=82546) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Copying metadata from image 35717e41-b49c-4e85-9a50-2d2207b8655c to 67559416-439a-4655-b663-e344b829b676. {{(pid=82546) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Creating volume glance metadata for volume 67559416-439a-4655-b663-e344b829b676 backed by image 35717e41-b49c-4e85-9a50-2d2207b8655c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82546) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a76b44-5be7-49f1-92f1-a5260046101c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67559416-439a-4655-b663-e344b829b676', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8113d2aa-a50d-4a44-a7b5-26bd52954523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:45 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Volume volume-67559416-439a-4655-b663-e344b829b676 (67559416-439a-4655-b663-e344b829b676): created successfully Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8113d2aa-a50d-4a44-a7b5-26bd52954523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Flow 'volume_create_manager' (ab5f1a8a-25cb-43f2-9fc3-a4f71c585a78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:45 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-90a0a694-8d5e-41d2-a90a-1563c13c49fa tempest-VolumesExtendTest-802641647 None] Created volume successfully. Apr 10 12:19:45 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 1073741824" returned: 0 in 0.515s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:45 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 Apr 10 12:19:45 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Flow 'volume_create_manager' (94f7dd8b-10a9-43dc-a00c-a668f92aed6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2e723c-496e-42b8-bffe-8ef262424f5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2e723c-496e-42b8-bffe-8ef262424f5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1408001689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6549d727-9566-4fad-899f-be9ccd0600fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9583b98587fc4e2da058ef465a84cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:46Z,use_quota=True,user_id='baab0e503f14427b9bad18a63a660250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d8bdf5-d650-4e5d-9c20-8d957f3dd221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d8bdf5-d650-4e5d-9c20-8d957f3dd221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efc2eda-b74f-4120-affa-858761ab4130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efc2eda-b74f-4120-affa-858761ab4130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6549d727-9566-4fad-899f-be9ccd0600fc', 'volume_name': 'volume-6549d727-9566-4fad-899f-be9ccd0600fc', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a200c9-ae46-404a-89cd-23f443bb3db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81a200c9-ae46-404a-89cd-23f443bb3db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6116f1b-d7df-4a54-b88e-60d226604180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:46 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Volume 6549d727-9566-4fad-899f-be9ccd0600fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6549d727-9566-4fad-899f-be9ccd0600fc', 'volume_size': 1} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:46 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256" returned: 0 in 0.463s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.192s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1408001689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6549d727-9566-4fad-899f-be9ccd0600fc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9583b98587fc4e2da058ef465a84cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:46Z,use_quota=True,user_id='baab0e503f14427b9bad18a63a660250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Creating volume 6549d727-9566-4fad-899f-be9ccd0600fc {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:46 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:46 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc 1073741824 Apr 10 12:19:46 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae9cfa79-ad01-44bb-87c3-92bc95621cbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-497fa008-1188-407c-a440-eab216b0a256', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9875a089-fb1a-4361-986d-cbc2e67ecd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:46 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Volume volume-497fa008-1188-407c-a440-eab216b0a256 (497fa008-1188-407c-a440-eab216b0a256): created successfully Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9875a089-fb1a-4361-986d-cbc2e67ecd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Flow 'volume_create_manager' (05842bf3-e103-4df7-b61f-4a69f1708ee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e40c7ab0-a82a-49fd-bfb9-e7e08d2a019e tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created volume successfully. Apr 10 12:19:46 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc 1073741824" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:46 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc Apr 10 12:19:46 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-497fa008-1188-407c-a440-eab216b0a256-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-497fa008-1188-407c-a440-eab216b0a256-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-quobyte-497fa008-1188-407c-a440-eab216b0a256" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-497fa008-1188-407c-a440-eab216b0a256" acquired by "delete_volume" :: waited 0.020s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1345b607-7031-4971-a2d0-7c0b1492af8c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:47 devstack sudo[89016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 Apr 10 12:19:47 devstack sudo[89016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:47 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc" returned: 0 in 0.458s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.939s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6116f1b-d7df-4a54-b88e-60d226604180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6549d727-9566-4fad-899f-be9ccd0600fc', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfa7dc7-deac-44d0-87f4-1fc5acb6ef8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:47 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Volume volume-6549d727-9566-4fad-899f-be9ccd0600fc (6549d727-9566-4fad-899f-be9ccd0600fc): created successfully Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdfa7dc7-deac-44d0-87f4-1fc5acb6ef8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Flow 'volume_create_manager' (94f7dd8b-10a9-43dc-a00c-a668f92aed6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3567f493-ab56-4df9-9298-60cb86a9d7f6]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-37feedfb-08be-4116-9107-e94de0a81a2d tempest-VolumesListTestJSON-2122505942 None] Created volume successfully. Apr 10 12:19:47 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:47 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:47 devstack sudo[89016]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:47 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256 Apr 10 12:19:47 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:47 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:47 devstack sudo[89028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:47 devstack sudo[89028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:47 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-497fa008-1188-407c-a440-eab216b0a256" returned: 0 in 0.419s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-497fa008-1188-407c-a440-eab216b0a256" released by "delete_volume" :: held 0.930s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:47 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created reservations ['d2d2e5ff-526d-4d16-bdd1-6bfecdb8a98e', 'dfb684db-34ab-4932-8ba8-e62511f65908', '61a3af45-314c-4ee4-85ab-5b213a98c928', '37bef691-4904-4334-969c-ae4cf8c6b3db'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:48 devstack sudo[89031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:48 devstack sudo[89031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-237ac1f7-97c7-4062-8fb1-e7929b1d0011-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-237ac1f7-97c7-4062-8fb1-e7929b1d0011-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-quobyte-237ac1f7-97c7-4062-8fb1-e7929b1d0011" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-237ac1f7-97c7-4062-8fb1-e7929b1d0011" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7925d6e-30a2-44b2-9ec3-5a21ffeab3bd]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:48 devstack sudo[89033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 Apr 10 12:19:48 devstack sudo[89033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:48 devstack sudo[89028]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 1 in 0.548s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 2G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 2G" returned: 0 in 0.107s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.174s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Flow 'volume_create_manager' (2a096fb6-77c0-4495-9d05-df0bb3fe1642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c806d8d-b83f-4ca2-ba1e-7c5417aec556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:48 devstack sudo[89031]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c806d8d-b83f-4ca2-ba1e-7c5417aec556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1158689268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f1378d-9513-437d-8243-6d411a67ec79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9583b98587fc4e2da058ef465a84cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:48Z,use_quota=True,user_id='baab0e503f14427b9bad18a63a660250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754e630c-67d8-4b4a-a9ba-6d6e92b4cb51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754e630c-67d8-4b4a-a9ba-6d6e92b4cb51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c7cf40-68bc-420e-82b9-9640218a3c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81c7cf40-68bc-420e-82b9-9640218a3c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7f1378d-9513-437d-8243-6d411a67ec79', 'volume_name': 'volume-f7f1378d-9513-437d-8243-6d411a67ec79', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eaa4f77-85ff-4a99-8aae-62ce897fa382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0eaa4f77-85ff-4a99-8aae-62ce897fa382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4287da42-2cf1-47c0-bd32-877539da84e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:48 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Volume f7f1378d-9513-437d-8243-6d411a67ec79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7f1378d-9513-437d-8243-6d411a67ec79', 'volume_size': 1} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1158689268',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7f1378d-9513-437d-8243-6d411a67ec79,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9583b98587fc4e2da058ef465a84cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:48Z,use_quota=True,user_id='baab0e503f14427b9bad18a63a660250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Creating volume f7f1378d-9513-437d-8243-6d411a67ec79 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:48 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.541s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:48 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Deleted volume successfully. Apr 10 12:19:48 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2460791f-6fd5-43c2-afa1-ec10495c18fe tempest-VolumesExtendTest-802641647 None] Extend volume completed successfully. Apr 10 12:19:48 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 1073741824 Apr 10 12:19:48 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2cdaf99a-4b79-4840-9fc7-dc506f1101f7 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-497fa008-1188-407c-a440-eab216b0a256-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:48 devstack sudo[89033]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011" returned: 0 in 0.600s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:48 devstack sudo[89047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011 Apr 10 12:19:48 devstack sudo[89047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:49 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 1073741824" returned: 0 in 0.481s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:49 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 Apr 10 12:19:49 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:49 devstack sudo[89047]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-237ac1f7-97c7-4062-8fb1-e7929b1d0011" returned: 0 in 0.428s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-237ac1f7-97c7-4062-8fb1-e7929b1d0011" released by "delete_volume" :: held 1.053s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created reservations ['69f9bf06-e091-40b9-855f-31751d46b4ad', 'f0b9a18b-4805-4d06-ab90-0024378f5602', '61e1061b-4f19-4c02-bd12-90f6415390ac', 'e63e1149-368a-48a2-a269-f9f91105b34b'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:49 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:49 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:49 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4287da42-2cf1-47c0-bd32-877539da84e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7f1378d-9513-437d-8243-6d411a67ec79', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d68e81-a71e-484b-b32e-e812ab0d5e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:49 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Volume volume-f7f1378d-9513-437d-8243-6d411a67ec79 (f7f1378d-9513-437d-8243-6d411a67ec79): created successfully Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67d68e81-a71e-484b-b32e-e812ab0d5e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Flow 'volume_create_manager' (2a096fb6-77c0-4495-9d05-df0bb3fe1642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:49 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7eee74d0-b9bb-4979-bd7f-c43b0de92713 tempest-VolumesListTestJSON-2122505942 None] Created volume successfully. Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Acquiring lock "cinder-67559416-439a-4655-b663-e344b829b676-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Lock "cinder-67559416-439a-4655-b663-e344b829b676-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Acquiring lock "cinder-quobyte-67559416-439a-4655-b663-e344b829b676" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:49 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Lock "cinder-quobyte-67559416-439a-4655-b663-e344b829b676" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.457s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:49 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Deleted volume successfully. Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ab706950-d38b-4a0e-b162-492c604447b2 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-237ac1f7-97c7-4062-8fb1-e7929b1d0011-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5907f569-bcb2-4ad7-92fa-de98155eeec2]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:49 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:49 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:50 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 0 in 0.468s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:50 devstack sudo[89063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:50 devstack sudo[89063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-f229266b-f062-47c1-a415-d1157ad3223b-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-f229266b-f062-47c1-a415-d1157ad3223b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-quobyte-f229266b-f062-47c1-a415-d1157ad3223b" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-f229266b-f062-47c1-a415-d1157ad3223b" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[db79da93-2ff5-4db9-9d04-cef3211ac57b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:50 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b Apr 10 12:19:50 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:50 devstack sudo[89063]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 1 in 0.513s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:50 devstack sudo[89070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676 Apr 10 12:19:50 devstack sudo[89070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:50 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b" returned: 0 in 0.535s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:50 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b Apr 10 12:19:50 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Flow 'volume_create_manager' (c2404fbf-4189-475e-8b05-ea59f648d2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea265ce3-c51d-45e4-9295-93f4652e40d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea265ce3-c51d-45e4-9295-93f4652e40d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1563453778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a5de07-7c80-4586-aaf3-9f42b51b7846,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9583b98587fc4e2da058ef465a84cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:51Z,use_quota=True,user_id='baab0e503f14427b9bad18a63a660250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3acff16-5321-4075-adc4-610954eeb273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3acff16-5321-4075-adc4-610954eeb273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080e4ba9-918d-4b17-9576-f72d456f17ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080e4ba9-918d-4b17-9576-f72d456f17ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76a5de07-7c80-4586-aaf3-9f42b51b7846', 'volume_name': 'volume-76a5de07-7c80-4586-aaf3-9f42b51b7846', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b6b07e-fd12-499b-a9d2-dfd837c616fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b6b07e-fd12-499b-a9d2-dfd837c616fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c993ccb-6d60-4b44-b179-2768d3718ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:50 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Volume 76a5de07-7c80-4586-aaf3-9f42b51b7846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76a5de07-7c80-4586-aaf3-9f42b51b7846', 'volume_size': 1} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1563453778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76a5de07-7c80-4586-aaf3-9f42b51b7846,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9583b98587fc4e2da058ef465a84cd86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:51Z,use_quota=True,user_id='baab0e503f14427b9bad18a63a660250',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Creating volume 76a5de07-7c80-4586-aaf3-9f42b51b7846 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:50 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:50 devstack sudo[89077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 1073741824 Apr 10 12:19:50 devstack sudo[89077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:51 devstack sudo[89070]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-67559416-439a-4655-b663-e344b829b676" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Lock "cinder-quobyte-67559416-439a-4655-b663-e344b829b676" released by "delete_volume" :: held 1.519s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Created reservations ['cfc5c8a9-3482-4e1d-9f47-0bf1cdcc5a29', 'b8b9f3e4-2b0f-475e-bb43-26505aac9624', '0faf86d1-d9de-4c52-9475-ba13c37a4811', 'fa160cfe-9f00-44c3-8687-1736ca1eda61'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:51 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f229266b-f062-47c1-a415-d1157ad3223b" returned: 0 in 0.471s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-f229266b-f062-47c1-a415-d1157ad3223b" released by "delete_volume" :: held 1.041s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:51 devstack sudo[89116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:51 devstack sudo[89116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created reservations ['558f97c8-da62-4793-875e-9f9500ca6fd3', 'ff23890d-b93d-410a-80ea-d99af8e4ced1', 'ea07f792-d38c-4018-a8ee-332d100a8ddd', '92a83aa3-e68a-4c80-98ee-c6fd25b296ab'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:51 devstack sudo[89120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:51 devstack sudo[89120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:51 devstack sudo[89077]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 1073741824" returned: 0 in 0.550s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:51 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 Apr 10 12:19:51 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:51 devstack sudo[89116]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.461s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:51 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Deleted volume successfully. Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b808373a-5f12-4e70-9b69-0515347bfe7a tempest-VolumesExtendTest-802641647 None] Lock "cinder-67559416-439a-4655-b663-e344b829b676-delete_volume" released by "delete_volume" :: held 2.142s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:51 devstack sudo[89120]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.435s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:51 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Deleted volume successfully. Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6a79bba-e56c-426e-a4d8-88b7e201e47a tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-f229266b-f062-47c1-a415-d1157ad3223b-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:51 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c993ccb-6d60-4b44-b179-2768d3718ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76a5de07-7c80-4586-aaf3-9f42b51b7846', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a346970e-dc93-44fe-826a-4769cafeb784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:51 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Volume volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 (76a5de07-7c80-4586-aaf3-9f42b51b7846): created successfully Apr 10 12:19:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a346970e-dc93-44fe-826a-4769cafeb784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Flow 'volume_create_manager' (c2404fbf-4189-475e-8b05-ea59f648d2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:52 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c16fad32-f33f-42bf-88e5-c05de57d5d8d tempest-VolumesListTestJSON-2122505942 None] Created volume successfully. Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Flow 'volume_create_manager' (0d6c63b7-0800-4810-ba15-bb62982ff8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb214ba-d5bf-43fe-bfc5-56fd8327c28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb214ba-d5bf-43fe-bfc5-56fd8327c28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1479123187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d4f8d4-d934-4a93-85ac-4315cb6be4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d6f3ec493d4af1ab8fc5a3705d391d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:52Z,use_quota=True,user_id='90a02fafc3a746fdaed53c6cd499ecc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894519e8-c56b-4151-91de-3444872656f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (894519e8-c56b-4151-91de-3444872656f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5598c1a-26b8-4272-8b1d-5e233172f731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5598c1a-26b8-4272-8b1d-5e233172f731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07d4f8d4-d934-4a93-85ac-4315cb6be4f5', 'volume_name': 'volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad406240-670b-4a15-b37d-b60a3d9031da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad406240-670b-4a15-b37d-b60a3d9031da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf892be-82e3-4e5a-9952-b4219e729f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:52 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Volume 07d4f8d4-d934-4a93-85ac-4315cb6be4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5', 'volume_size': 1} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:19:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1479123187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07d4f8d4-d934-4a93-85ac-4315cb6be4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55d6f3ec493d4af1ab8fc5a3705d391d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:19:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:19:52Z,use_quota=True,user_id='90a02fafc3a746fdaed53c6cd499ecc7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Creating volume 07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:19:52 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:52 devstack sudo[89127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 1073741824 Apr 10 12:19:52 devstack sudo[89127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-4bc7c3b7-452a-4e91-a6a6-74e74932b701-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-4bc7c3b7-452a-4e91-a6a6-74e74932b701-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-quobyte-4bc7c3b7-452a-4e91-a6a6-74e74932b701" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-4bc7c3b7-452a-4e91-a6a6-74e74932b701" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef10e469-f1b8-46c5-8cab-1b5316e29b0d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:52 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 Apr 10 12:19:52 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:52 devstack sudo[89127]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 1073741824" returned: 0 in 0.488s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:52 devstack sudo[89134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 Apr 10 12:19:52 devstack sudo[89134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:53 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701" returned: 0 in 0.547s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:53 devstack sudo[89134]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" returned: 0 in 0.436s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:53 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701 Apr 10 12:19:53 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf892be-82e3-4e5a-9952-b4219e729f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14a386a-424e-4557-964d-4cd7cd9f2e43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:19:53 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Volume volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 (07d4f8d4-d934-4a93-85ac-4315cb6be4f5): created successfully Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b14a386a-424e-4557-964d-4cd7cd9f2e43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Flow 'volume_create_manager' (0d6c63b7-0800-4810-ba15-bb62982ff8db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:19:53 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0064bf15-0e25-412b-96d8-d1e4a6f0208d tempest-VolumesExtendTest-802641647 None] Created volume successfully. Apr 10 12:19:53 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4bc7c3b7-452a-4e91-a6a6-74e74932b701" returned: 0 in 0.455s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-4bc7c3b7-452a-4e91-a6a6-74e74932b701" released by "delete_volume" :: held 1.028s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created reservations ['081d14f1-c915-43ad-8ea3-1556cee42d21', 'ec4c3ff0-d1d7-4d98-906f-e301e0d387f7', '9e27b450-2e9e-47e3-9a89-4695edbdd8df', 'd7b96c33-28ab-4bab-b06a-1fee3337bc60'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:53 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:53 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:54 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.433s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:54 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Deleted volume successfully. Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ce06c6ea-55f4-4b13-8d6a-75676be3fecb tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-4bc7c3b7-452a-4e91-a6a6-74e74932b701-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Creating offline snapshot 2b604a9b-4ad1-4ab3-b522-1c61c39a221c of volume 07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af20768-afd2-4f84-ae2d-303de33e3614]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:54 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 Apr 10 12:19:54 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "cinder-76a5de07-7c80-4586-aaf3-9f42b51b7846-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-76a5de07-7c80-4586-aaf3-9f42b51b7846-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "cinder-quobyte-76a5de07-7c80-4586-aaf3-9f42b51b7846" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-quobyte-76a5de07-7c80-4586-aaf3-9f42b51b7846" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-8a54e361-3017-4352-ab86-08ef494bfe56-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe073c-70f0-40b5-a965-9a90b73d4a47]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-8a54e361-3017-4352-ab86-08ef494bfe56-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-quobyte-8a54e361-3017-4352-ab86-08ef494bfe56" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-8a54e361-3017-4352-ab86-08ef494bfe56" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d04ed03b-bfb0-4490-9e97-0b3d5a6828fe]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:54 devstack sudo[89150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 Apr 10 12:19:54 devstack sudo[89150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:54 devstack sudo[89151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 Apr 10 12:19:54 devstack sudo[89151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:54 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" returned: 0 in 0.504s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:54 devstack sudo[89157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c 1G Apr 10 12:19:54 devstack sudo[89157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:55 devstack sudo[89150]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846" returned: 0 in 0.503s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:55 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846 Apr 10 12:19:55 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:55 devstack sudo[89151]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56" returned: 0 in 0.480s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:55 devstack sudo[89167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56 Apr 10 12:19:55 devstack sudo[89167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:55 devstack sudo[89157]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c 1G" returned: 0 in 0.494s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:55 devstack sudo[89172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c Apr 10 12:19:55 devstack sudo[89172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:55 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-76a5de07-7c80-4586-aaf3-9f42b51b7846" returned: 0 in 0.446s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-quobyte-76a5de07-7c80-4586-aaf3-9f42b51b7846" released by "delete_volume" :: held 0.975s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:55 devstack sudo[89167]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8a54e361-3017-4352-ab86-08ef494bfe56" returned: 0 in 0.445s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-8a54e361-3017-4352-ab86-08ef494bfe56" released by "delete_volume" :: held 0.949s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Created reservations ['b9ef9722-e9ab-40b3-93ef-eea82e8e19e5', '9b096758-e052-4781-9791-c4c53fa058fd', '9d5d2c54-2286-44e4-8ad9-abd5b006b926', '9d84da78-7477-4cfb-81ed-3d97ef48f284'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created reservations ['0614d070-fa3a-40bf-b63d-8c62924385b2', 'c659e54e-d301-4bfc-a22e-54f58a4e1ca7', '972a8251-d2bb-4bd0-9842-5823fb85089f', '4f9e26ee-b509-4648-9aaf-65130b9fb268'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:55 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:55 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:55 devstack sudo[89181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:55 devstack sudo[89181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:55 devstack sudo[89172]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c" returned: 0 in 0.466s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:55 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c is being set with open permissions: ugo+rw Apr 10 12:19:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:55 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c Apr 10 12:19:55 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:56 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Deleted volume successfully. Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-feb457f1-21d9-4b52-a583-682ed1ef9951 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-76a5de07-7c80-4586-aaf3-9f42b51b7846-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:56 devstack sudo[89181]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.428s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Deleted volume successfully. Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-05680290-a52f-49c7-be29-850e26f56244 tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-8a54e361-3017-4352-ab86-08ef494bfe56-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:56 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:56 devstack sudo[89188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.info Apr 10 12:19:56 devstack sudo[89188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:56 devstack sudo[89188]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.info" returned: 0 in 0.420s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:56 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.info is being set with open permissions: ugo+rw Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:56 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.info Apr 10 12:19:56 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-7ad02003-3a60-4590-9b32-4d40f66c8d03-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-7ad02003-3a60-4590-9b32-4d40f66c8d03-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "cinder-quobyte-7ad02003-3a60-4590-9b32-4d40f66c8d03" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-7ad02003-3a60-4590-9b32-4d40f66c8d03" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c64339-2a5c-4986-be16-891315b89f5f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:56 devstack sudo[89193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 Apr 10 12:19:56 devstack sudo[89193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "cinder-f7f1378d-9513-437d-8243-6d411a67ec79-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-f7f1378d-9513-437d-8243-6d411a67ec79-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "cinder-quobyte-f7f1378d-9513-437d-8243-6d411a67ec79" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-quobyte-f7f1378d-9513-437d-8243-6d411a67ec79" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[76252d58-f00e-4227-bcd1-b418c2dbaffb]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:57 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 Apr 10 12:19:57 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:57 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.info" returned: 0 in 0.456s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.846s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:57 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-99aa0b46-9df5-4ed9-962a-f04969ba6cfd tempest-VolumesExtendTest-802641647 None] Create snapshot completed successfully Apr 10 12:19:57 devstack sudo[89193]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03" returned: 0 in 0.499s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:57 devstack sudo[89201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03 Apr 10 12:19:57 devstack sudo[89201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ff5db9fc-9479-44e3-8fb0-063fb5627bb2 tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ff5db9fc-9479-44e3-8fb0-063fb5627bb2 tempest-VolumesExtendTest-802641647 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[118b56c5-574c-4de4-b820-2d0b68f384be]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ff5db9fc-9479-44e3-8fb0-063fb5627bb2 tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:57 devstack sudo[89203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 Apr 10 12:19:57 devstack sudo[89203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:57 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79" returned: 0 in 0.540s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:57 devstack sudo[89208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79 Apr 10 12:19:57 devstack sudo[89208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:57 devstack sudo[89201]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ad02003-3a60-4590-9b32-4d40f66c8d03" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-quobyte-7ad02003-3a60-4590-9b32-4d40f66c8d03" released by "delete_volume" :: held 0.984s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Created reservations ['cb8a6d57-fe90-4021-a47c-41e2bbcd8578', 'c2990e28-0663-466c-be75-10b93ef31417', '8775b21a-dfcf-40f7-8158-35dd1c2316fe', '4159e751-ffd0-4745-9f5f-448e714bb167'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:57 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:57 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:58 devstack sudo[89203]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ff5db9fc-9479-44e3-8fb0-063fb5627bb2 tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ff5db9fc-9479-44e3-8fb0-063fb5627bb2 tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c 2G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:58 devstack sudo[89208]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f7f1378d-9513-437d-8243-6d411a67ec79" returned: 0 in 0.435s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-quobyte-f7f1378d-9513-437d-8243-6d411a67ec79" released by "delete_volume" :: held 1.005s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ff5db9fc-9479-44e3-8fb0-063fb5627bb2 tempest-VolumesExtendTest-802641647 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c 2G" returned: 0 in 0.092s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ff5db9fc-9479-44e3-8fb0-063fb5627bb2 tempest-VolumesExtendTest-802641647 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.606s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Created reservations ['54d8fcfa-a8fd-4641-9cf4-5235f3372d33', '4ebba234-d32b-44fb-ba60-2164a50e034a', '6f3475e2-0d5a-4cb2-a0e4-7031c624fdf9', '89802199-46ad-4f75-8766-6bcaaa7b6e61'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:58 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:19:58 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:58 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ff5db9fc-9479-44e3-8fb0-063fb5627bb2 tempest-VolumesExtendTest-802641647 None] Extend volume completed successfully. Apr 10 12:19:58 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.436s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:58 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Deleted volume successfully. Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e6e9bc6a-a3c5-4c69-a602-8d619abb5dbf tempest-CreateVolumesFromSourceVolumeTest-2125194693 None] Lock "cinder-7ad02003-3a60-4590-9b32-4d40f66c8d03-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:58 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:19:58 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Deleted volume successfully. Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a0ddf692-510d-4b4d-82ea-abdffcc8b973 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-f7f1378d-9513-437d-8243-6d411a67ec79-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Acquiring lock "cinder-2b604a9b-4ad1-4ab3-b522-1c61c39a221c-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Lock "cinder-2b604a9b-4ad1-4ab3-b522-1c61c39a221c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Acquiring lock "cinder-quobyte-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Lock "cinder-quobyte-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Acquiring lock "cinder-quobyte-2b604a9b-4ad1-4ab3-b522-1c61c39a221c" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Lock "cinder-quobyte-2b604a9b-4ad1-4ab3-b522-1c61c39a221c" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Deleting offline snapshot 2b604a9b-4ad1-4ab3-b522-1c61c39a221c of volume 07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] snapshot_file for this snap is: volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc0337-89a1-467a-af31-84edbf8ce5aa]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:58 devstack sudo[89224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c Apr 10 12:19:58 devstack sudo[89224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:59 devstack sudo[89224]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c25992c-9c06-4ec5-acf2-0c619f397382]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "cinder-6549d727-9566-4fad-899f-be9ccd0600fc-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-6549d727-9566-4fad-899f-be9ccd0600fc-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "cinder-quobyte-6549d727-9566-4fad-899f-be9ccd0600fc" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-quobyte-6549d727-9566-4fad-899f-be9ccd0600fc" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4ae4e9-603c-4193-8691-f7136ee08501]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:59 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 Apr 10 12:19:59 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:59 devstack sudo[89230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc Apr 10 12:19:59 devstack sudo[89230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:59 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" returned: 0 in 0.575s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:59 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c Apr 10 12:19:59 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:19:59 devstack sudo[89230]: pam_unix(sudo:session): session closed for user root Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc" returned: 0 in 0.563s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:19:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:19:59 devstack sudo[89242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc Apr 10 12:19:59 devstack sudo[89242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:00 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c" returned: 0 in 0.530s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:00 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c Apr 10 12:20:00 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:00 devstack sudo[89242]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-6549d727-9566-4fad-899f-be9ccd0600fc" returned: 0 in 0.471s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-quobyte-6549d727-9566-4fad-899f-be9ccd0600fc" released by "delete_volume" :: held 1.057s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Created reservations ['3e50dd81-65f1-4c2e-8ec5-8bcfa035f513', '630186e4-7837-4283-8a2e-1c6c8ad494c9', 'c1a63c6e-1b2f-4233-886f-0d67027f8056', 'c7b6655f-8e62-4285-a54a-41987dc7882a'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:00 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:00 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Flow 'volume_create_manager' (2008ef7a-bb83-4e92-99ff-955286d187c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08d1bfc-6d96-4832-b9c6-3fcce893f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a08d1bfc-6d96-4832-b9c6-3fcce893f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934923051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1379fcc-218a-40f6-9c5b-3c55151bd3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600ecfd5ad5243a3baed4929129a32b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:01Z,use_quota=True,user_id='eebe0673a1a243fbb97119588a6be2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5029bc6a-7e8a-4ef9-ac46-87e0d6b3a752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5029bc6a-7e8a-4ef9-ac46-87e0d6b3a752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a321d4ad-00d2-4b16-bb12-6cb6788378df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a321d4ad-00d2-4b16-bb12-6cb6788378df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1379fcc-218a-40f6-9c5b-3c55151bd3f9', 'volume_name': 'volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acecc999-35e1-491c-aebd-ffa492920943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acecc999-35e1-491c-aebd-ffa492920943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bcd67f0-5f0c-4555-80c6-7372829d6f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:00 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Volume d1379fcc-218a-40f6-9c5b-3c55151bd3f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9', 'volume_size': 1} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-934923051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1379fcc-218a-40f6-9c5b-3c55151bd3f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600ecfd5ad5243a3baed4929129a32b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:01Z,use_quota=True,user_id='eebe0673a1a243fbb97119588a6be2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Creating volume d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:00 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:00 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 1073741824 Apr 10 12:20:00 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:00 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5.2b604a9b-4ad1-4ab3-b522-1c61c39a221c" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Lock "cinder-quobyte-2b604a9b-4ad1-4ab3-b522-1c61c39a221c" released by "_delete_snapshot" :: held 2.111s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Lock "cinder-quobyte-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" released by "delete_snapshot" :: held 2.122s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Created reservations ['e4606916-0a9e-4a66-b34d-2769ba3543f3', '6d0a9f9f-4f14-4034-883a-25cb440b16a9', '0d632879-a43c-40ce-8370-bdd3ce19bc67', 'b5b5af8a-365a-476a-befb-9806f5c6d03e'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Delete snapshot completed successfully. Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-624c93d3-984e-43f5-ab28-a8d619835335 tempest-VolumesExtendTest-802641647 None] Lock "cinder-2b604a9b-4ad1-4ab3-b522-1c61c39a221c-delete_snapshot" released by "delete_snapshot" :: held 2.206s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:00 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.454s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Deleted volume successfully. Apr 10 12:20:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-edfba012-e657-4677-8beb-ed03e2233265 tempest-VolumesListTestJSON-2122505942 None] Lock "cinder-6549d727-9566-4fad-899f-be9ccd0600fc-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:01 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 1073741824" returned: 0 in 0.491s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:01 devstack sudo[89259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 Apr 10 12:20:01 devstack sudo[89259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:01 devstack sudo[89259]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" returned: 0 in 0.435s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bcd67f0-5f0c-4555-80c6-7372829d6f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bfc4a9-3c37-4533-8fad-751e38b81b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:01 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Volume volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 (d1379fcc-218a-40f6-9c5b-3c55151bd3f9): created successfully Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41bfc4a9-3c37-4533-8fad-751e38b81b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Flow 'volume_create_manager' (2008ef7a-bb83-4e92-99ff-955286d187c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:01 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7e4818da-a6fe-497f-8d47-faefbc18ac27 tempest-VolumeDependencyTests-267471377 None] Created volume successfully. Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Acquiring lock "cinder-07d4f8d4-d934-4a93-85ac-4315cb6be4f5-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Lock "cinder-07d4f8d4-d934-4a93-85ac-4315cb6be4f5-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Acquiring lock "cinder-quobyte-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Lock "cinder-quobyte-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:02 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2e8110-09d9-401e-8a6c-0c199f67cafa]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:02 devstack sudo[89262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 Apr 10 12:20:02 devstack sudo[89262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:02 devstack sudo[89262]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" returned: 0 in 0.523s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:02 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5 Apr 10 12:20:02 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:03 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" returned: 0 in 0.513s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Lock "cinder-quobyte-07d4f8d4-d934-4a93-85ac-4315cb6be4f5" released by "delete_volume" :: held 1.077s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Creating offline snapshot 63b67876-ecaf-49d4-a565-27d9fb090998 of volume d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7cc6b5-1ac5-4201-b87b-d0b796f604c0]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Created reservations ['f735ed1b-ba34-4fa4-b266-179aa147d300', '28f50ae1-9425-4ff6-8bf0-a225bc1568b3', '5fb9773f-6bdc-4e04-af25-64a51b6bbb9d', '64b0b112-3746-4165-8ced-18139c82d781'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:03 devstack sudo[89270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 Apr 10 12:20:03 devstack sudo[89270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:03 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:03 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Flow 'volume_create_manager' (2db4ec11-8992-4cf9-8cf2-4286366de414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107a6f3a-5282-4e75-8462-4c629b3dc94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (107a6f3a-5282-4e75-8462-4c629b3dc94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1693933167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350d5cbd-df8b-43dc-9a79-5f1e96922a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f963d05831d74d1f9101a0d20b7bc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:03Z,use_quota=True,user_id='089ab86a9bd543ea9632da6150fc6d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a05cb2-aa71-4717-8ca9-25903fd63379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a05cb2-aa71-4717-8ca9-25903fd63379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1eeb2e1-07c4-4364-9dfc-1e22eca5145c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1eeb2e1-07c4-4364-9dfc-1e22eca5145c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '350d5cbd-df8b-43dc-9a79-5f1e96922a82', 'volume_name': 'volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bdb0b6-16ca-4f82-9560-13e788acb75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87bdb0b6-16ca-4f82-9560-13e788acb75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae34c2b9-65e7-4804-bc3a-43fcecee6122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:03 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Volume 350d5cbd-df8b-43dc-9a79-5f1e96922a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82', 'volume_size': 1} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:03 devstack sudo[89270]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" returned: 0 in 0.501s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:03 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.433s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:03 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Deleted volume successfully. Apr 10 12:20:03 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 1G Apr 10 12:20:03 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:03 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-25101af4-8445-48ec-9677-fac27be5859f tempest-VolumesExtendTest-802641647 None] Lock "cinder-07d4f8d4-d934-4a93-85ac-4315cb6be4f5-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:04 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 1G" returned: 0 in 0.490s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:04 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 Apr 10 12:20:04 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:04 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998" returned: 0 in 0.455s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:04 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 is being set with open permissions: ugo+rw Apr 10 12:20:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:04 devstack sudo[89289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 Apr 10 12:20:04 devstack sudo[89289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:05 devstack sudo[89289]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998" returned: 0 in 0.455s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:05 devstack sudo[89292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.info Apr 10 12:20:05 devstack sudo[89292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:05 devstack sudo[89292]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.info" returned: 0 in 0.489s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:05 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.info is being set with open permissions: ugo+rw Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:05 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.info Apr 10 12:20:05 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (18a22e5b-1fb3-4bae-a6e3-9d839fa3259c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b77cd6-47e4-4c4d-901b-eb31d35c2be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62b77cd6-47e4-4c4d-901b-eb31d35c2be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1873036066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de39ca6-17c2-4707-9068-8f288b328072,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:06Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3ce6f8-b709-4d11-88fa-4c5354ada08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad3ce6f8-b709-4d11-88fa-4c5354ada08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e90114-e973-4b5d-9183-0668dec14e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e90114-e973-4b5d-9183-0668dec14e05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de39ca6-17c2-4707-9068-8f288b328072', 'volume_name': 'volume-5de39ca6-17c2-4707-9068-8f288b328072', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d997eb-cafc-4308-b30f-ed6b889785bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d997eb-cafc-4308-b30f-ed6b889785bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d789a57a-5e56-4c61-8bc9-6428fdb6ce76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:05 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Volume 5de39ca6-17c2-4707-9068-8f288b328072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de39ca6-17c2-4707-9068-8f288b328072', 'volume_size': 1} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:05 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.info" returned: 0 in 0.441s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.899s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.692s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1693933167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=350d5cbd-df8b-43dc-9a79-5f1e96922a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f963d05831d74d1f9101a0d20b7bc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:03Z,use_quota=True,user_id='089ab86a9bd543ea9632da6150fc6d59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Creating volume 350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:05 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:06 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-15952866-b9e9-4668-bb84-91ea57e90feb tempest-VolumeDependencyTests-267471377 None] Create snapshot completed successfully Apr 10 12:20:06 devstack sudo[89298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 1073741824 Apr 10 12:20:06 devstack sudo[89298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Flow 'volume_create_manager' (a9fc8332-9ce7-4e3e-91ef-063c0a88d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff723de-d514-4bd8-ab31-99d27f31ff41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aff723de-d514-4bd8-ab31-99d27f31ff41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1793505555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0054c370-6f27-475a-8610-a2315a28c15c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600ecfd5ad5243a3baed4929129a32b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=63b67876-ecaf-49d4-a565-27d9fb090998,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:06Z,use_quota=True,user_id='eebe0673a1a243fbb97119588a6be2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b2dd6f-f319-4bf6-b6cd-bd91bfbc56b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b2dd6f-f319-4bf6-b6cd-bd91bfbc56b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fc44a2-acaa-407c-a1eb-d4c45e5780b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8fc44a2-acaa-407c-a1eb-d4c45e5780b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0054c370-6f27-475a-8610-a2315a28c15c', 'volume_name': 'volume-0054c370-6f27-475a-8610-a2315a28c15c', 'volume_size': 1, 'snapshot_id': '63b67876-ecaf-49d4-a565-27d9fb090998'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df13264-fb21-426e-9da9-764a0df6ebf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2df13264-fb21-426e-9da9-764a0df6ebf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6e2a79-589b-4dff-92e4-affeec7d4256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:06 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Volume 0054c370-6f27-475a-8610-a2315a28c15c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0054c370-6f27-475a-8610-a2315a28c15c', 'volume_size': 1, 'snapshot_id': '63b67876-ecaf-49d4-a565-27d9fb090998'} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:06 devstack sudo[89298]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 1073741824" returned: 0 in 0.509s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:06 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 Apr 10 12:20:06 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:06 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82" returned: 0 in 0.420s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1873036066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de39ca6-17c2-4707-9068-8f288b328072,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:06Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Creating volume 5de39ca6-17c2-4707-9068-8f288b328072 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:06 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae34c2b9-65e7-4804-bc3a-43fcecee6122) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3809303-a1e6-40dc-ae28-fd8a20adb8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:06 devstack sudo[89306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 1073741824 Apr 10 12:20:06 devstack sudo[89306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:06 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Volume volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 (350d5cbd-df8b-43dc-9a79-5f1e96922a82): created successfully Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3809303-a1e6-40dc-ae28-fd8a20adb8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Flow 'volume_create_manager' (2db4ec11-8992-4cf9-8cf2-4286366de414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:06 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b7672039-56fe-4a1d-aad5-bb6610bd5a88 tempest-VolumesSnapshotListTestJSON-1770888340 None] Created volume successfully. Apr 10 12:20:07 devstack sudo[89306]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 1073741824" returned: 0 in 0.497s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:07 devstack sudo[89311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 Apr 10 12:20:07 devstack sudo[89311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:07 devstack sudo[89311]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072" returned: 0 in 0.425s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.457s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-63b67876-ecaf-49d4-a565-27d9fb090998-0054c370-6f27-475a-8610-a2315a28c15c" by "_create_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-63b67876-ecaf-49d4-a565-27d9fb090998-0054c370-6f27-475a-8610-a2315a28c15c" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Creating volume 0054c370-6f27-475a-8610-a2315a28c15c from snapshot 63b67876-ecaf-49d4-a565-27d9fb090998 {{(pid=82546) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-0054c370-6f27-475a-8610-a2315a28c15c" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d789a57a-5e56-4c61-8bc9-6428fdb6ce76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de39ca6-17c2-4707-9068-8f288b328072', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f241e06c-5a5e-4e94-b9a7-fe889a9611ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:07 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Volume volume-5de39ca6-17c2-4707-9068-8f288b328072 (5de39ca6-17c2-4707-9068-8f288b328072): created successfully Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f241e06c-5a5e-4e94-b9a7-fe889a9611ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (18a22e5b-1fb3-4bae-a6e3-9d839fa3259c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-0054c370-6f27-475a-8610-a2315a28c15c" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] snapshot: 63b67876-ecaf-49d4-a565-27d9fb090998, volume: 0054c370-6f27-475a-8610-a2315a28c15c, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:07 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ce47dca1-bf9c-453d-b84d-2a3d1697601e tempest-VolumesGetTest-404837712 None] Created volume successfully. Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[48447538-6722-4f99-a2a3-acb6831215b3]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:08 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 Apr 10 12:20:08 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:08 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998" returned: 0 in 0.483s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47ffad7-661e-4d38-a117-279c9dd64127]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:08 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 Apr 10 12:20:08 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:08 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" returned: 0 in 0.482s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:20:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:08 devstack sudo[89324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c Apr 10 12:20:08 devstack sudo[89324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (a59fcd91-64eb-48c7-81fc-2cd5f4d17626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c43742-4de2-4bf9-9a34-e1fe88af1665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c43742-4de2-4bf9-9a34-e1fe88af1665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1716048072',display_name='tempest-VolumesGetTest-Volume-736284517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29facd30-b231-4b9e-8031-e1f920358481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:09Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ad38c8-7d2c-40df-880a-b7db0c45ae36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0ad38c8-7d2c-40df-880a-b7db0c45ae36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee06786-734d-4c98-8cc7-b844be2eeb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aee06786-734d-4c98-8cc7-b844be2eeb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29facd30-b231-4b9e-8031-e1f920358481', 'volume_name': 'volume-29facd30-b231-4b9e-8031-e1f920358481', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c84fca-7160-40a4-8ce1-c2a1470a2684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5c84fca-7160-40a4-8ce1-c2a1470a2684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f3890a-4305-4a45-9ac5-75547cf339c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:09 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Volume 29facd30-b231-4b9e-8031-e1f920358481: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29facd30-b231-4b9e-8031-e1f920358481', 'volume_size': 1} Apr 10 12:20:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:10 devstack sudo[89324]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c" returned: 0 in 2.052s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:11 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a41f3d-9e21-418d-a061-2838bdae83d4]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:11 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 Apr 10 12:20:11 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:11 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" returned: 0 in 0.600s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:11 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9, size 1024.00 MB, duration 2.05 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:20:11 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Converted 1024.00 MB image at 498.81 MB/s Apr 10 12:20:11 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c is being set with open permissions: ugo+rw Apr 10 12:20:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:11 devstack sudo[89341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c Apr 10 12:20:11 devstack sudo[89341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:12 devstack sudo[89341]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c" returned: 0 in 0.427s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-0054c370-6f27-475a-8610-a2315a28c15c" released by "_copy_volume_from_snapshot" :: held 4.100s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-63b67876-ecaf-49d4-a565-27d9fb090998-0054c370-6f27-475a-8610-a2315a28c15c" released by "_create_volume_from_snapshot" :: held 4.138s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.147s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.481s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Creating offline snapshot cb25e98b-d930-40cc-9fce-2b2f87557f86 of volume 350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c6e2a79-589b-4dff-92e4-affeec7d4256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0054c370-6f27-475a-8610-a2315a28c15c', 'volume_size': 1, 'snapshot_id': '63b67876-ecaf-49d4-a565-27d9fb090998'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba2c88f-d98b-46da-8977-15cb19ef262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[095a3317-ff97-4369-9f31-aafba3e43aa7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:12 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Volume volume-0054c370-6f27-475a-8610-a2315a28c15c (0054c370-6f27-475a-8610-a2315a28c15c): created successfully Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ba2c88f-d98b-46da-8977-15cb19ef262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Flow 'volume_create_manager' (a9fc8332-9ce7-4e3e-91ef-063c0a88d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:12 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b622e500-22b6-4b35-9ac3-29fabe758520 tempest-VolumeDependencyTests-267471377 None] Created volume successfully. Apr 10 12:20:12 devstack sudo[89344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 Apr 10 12:20:12 devstack sudo[89344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:12 devstack sudo[89344]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:12 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 1G Apr 10 12:20:12 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-63b67876-ecaf-49d4-a565-27d9fb090998-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Lock "cinder-63b67876-ecaf-49d4-a565-27d9fb090998-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-63b67876-ecaf-49d4-a565-27d9fb090998" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-63b67876-ecaf-49d4-a565-27d9fb090998" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Deleting offline snapshot 63b67876-ecaf-49d4-a565-27d9fb090998 of volume d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] snapshot_file for this snap is: volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d15f6c2-4a45-4111-86c4-5b37b6e72b71]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:12 devstack sudo[89351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 Apr 10 12:20:12 devstack sudo[89351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:13 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 1G" returned: 0 in 0.500s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:13 devstack sudo[89356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 Apr 10 12:20:13 devstack sudo[89356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:13 devstack sudo[89351]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998" returned: 0 in 0.498s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca188fe-41b0-42f0-b6db-2ac41e1bd4cf]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:13 devstack sudo[89361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 Apr 10 12:20:13 devstack sudo[89361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:13 devstack sudo[89356]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86" returned: 0 in 0.454s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:13 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 is being set with open permissions: ugo+rw Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:13 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 Apr 10 12:20:13 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:13 devstack sudo[89361]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:13 devstack sudo[89371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 Apr 10 12:20:13 devstack sudo[89371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:13 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86" returned: 0 in 0.420s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:13 devstack sudo[89374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.info Apr 10 12:20:13 devstack sudo[89374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:14 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:14 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:14 devstack sudo[89371]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:14 devstack sudo[89382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998 Apr 10 12:20:14 devstack sudo[89382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:14 devstack sudo[89374]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.info" returned: 0 in 0.445s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:14 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.info is being set with open permissions: ugo+rw Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:14 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.info Apr 10 12:20:14 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:14 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.429s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:14 devstack sudo[89382]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9.63b67876-ecaf-49d4-a565-27d9fb090998" returned: 0 in 0.454s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-63b67876-ecaf-49d4-a565-27d9fb090998" released by "_delete_snapshot" :: held 1.979s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" released by "delete_snapshot" :: held 1.995s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Created reservations ['7abb3aa7-b272-438c-98a1-bab239d56d21', 'd5745158-5ee8-4d23-bb50-742568cb0c3b', '310f77eb-1aab-4e6e-b312-b84ca295abb2', '9edbaaa0-ca15-4385-b0d6-f70b63cf870c'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:14 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.info" returned: 0 in 0.448s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.828s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.500s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:09Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1716048072',display_name='tempest-VolumesGetTest-Volume-736284517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29facd30-b231-4b9e-8031-e1f920358481,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:09Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Creating volume 29facd30-b231-4b9e-8031-e1f920358481 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:14 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:14 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Delete snapshot completed successfully. Apr 10 12:20:14 devstack sudo[89390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 1073741824 Apr 10 12:20:14 devstack sudo[89390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-531245ba-1ed2-4bf2-a57c-30a6216f832b tempest-VolumeDependencyTests-267471377 None] Lock "cinder-63b67876-ecaf-49d4-a565-27d9fb090998-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-d1379fcc-218a-40f6-9c5b-3c55151bd3f9-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:14 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-555db991-e79c-4912-a8a3-b4b05e2275cd tempest-VolumesSnapshotListTestJSON-1770888340 None] Create snapshot completed successfully Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-d1379fcc-218a-40f6-9c5b-3c55151bd3f9-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b06c98c-6cef-4e2d-ab3b-dfabd8cd7c2d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:15 devstack sudo[89392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 Apr 10 12:20:15 devstack sudo[89392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:15 devstack sudo[89390]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 1073741824" returned: 0 in 0.510s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:15 devstack sudo[89400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 Apr 10 12:20:15 devstack sudo[89400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:15 devstack sudo[89392]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" returned: 0 in 0.506s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:15 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9 Apr 10 12:20:15 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:15 devstack sudo[89400]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481" returned: 0 in 0.446s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f3890a-4305-4a45-9ac5-75547cf339c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29facd30-b231-4b9e-8031-e1f920358481', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0bf0e5-1c52-4c6b-9bf7-6e66b3d2578e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:15 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Volume volume-29facd30-b231-4b9e-8031-e1f920358481 (29facd30-b231-4b9e-8031-e1f920358481): created successfully Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c0bf0e5-1c52-4c6b-9bf7-6e66b3d2578e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (a59fcd91-64eb-48c7-81fc-2cd5f4d17626) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:15 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-cd742413-cac6-441b-8cba-f47203970869 tempest-VolumesGetTest-404837712 None] Created volume successfully. Apr 10 12:20:15 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" returned: 0 in 0.442s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-d1379fcc-218a-40f6-9c5b-3c55151bd3f9" released by "delete_volume" :: held 0.977s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:15 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Created reservations ['4d50201b-7a89-4bec-ac72-a1eaa6578053', 'a36a8ab1-6b48-4a90-a710-904dde8e1085', '4da51f8e-77c3-4064-a3c2-4ab15e9a9abb', 'fc3e6523-fe12-41d9-b756-7c11ceec7ae0'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:16 devstack sudo[89406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:16 devstack sudo[89406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Creating offline snapshot 7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 of volume 350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f8df4d-8d15-4e7c-92da-acab9c5f3464]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:16 devstack sudo[89408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 Apr 10 12:20:16 devstack sudo[89408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:16 devstack sudo[89406]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Deleted volume successfully. Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7b2a6641-b468-448d-ba51-d08b9b949bf3 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-d1379fcc-218a-40f6-9c5b-3c55151bd3f9-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:16 devstack sudo[89408]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:16 devstack sudo[89414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 1G Apr 10 12:20:16 devstack sudo[89414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-29facd30-b231-4b9e-8031-e1f920358481-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Lock "cinder-29facd30-b231-4b9e-8031-e1f920358481-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-29facd30-b231-4b9e-8031-e1f920358481" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-29facd30-b231-4b9e-8031-e1f920358481" acquired by "delete_volume" :: waited 0.019s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82202de-442a-45fe-a31d-639ab707590c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:16 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 Apr 10 12:20:16 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:17 devstack sudo[89414]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 1G" returned: 0 in 0.533s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:17 devstack sudo[89421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 Apr 10 12:20:17 devstack sudo[89421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Flow 'volume_create_manager' (c9c5d5a7-0071-410f-94a9-cb90b0b18841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ee24e7-d70f-430c-9462-932389d9d34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:17 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481" returned: 0 in 0.524s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29ee24e7-d70f-430c-9462-932389d9d34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-459054975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687d08d0-103d-4f39-88e4-117acb0d4808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600ecfd5ad5243a3baed4929129a32b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:17Z,use_quota=True,user_id='eebe0673a1a243fbb97119588a6be2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5e6dbc-d619-4040-8362-43eb89ad497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:17 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481 Apr 10 12:20:17 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c5e6dbc-d619-4040-8362-43eb89ad497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9860215-c64f-4fd4-81d6-411c925feb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9860215-c64f-4fd4-81d6-411c925feb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '687d08d0-103d-4f39-88e4-117acb0d4808', 'volume_name': 'volume-687d08d0-103d-4f39-88e4-117acb0d4808', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768318b0-9544-4094-bfef-ee4db7bef247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (768318b0-9544-4094-bfef-ee4db7bef247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5789167-bc38-4dae-a986-07fbfcbbf8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:17 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Volume 687d08d0-103d-4f39-88e4-117acb0d4808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-687d08d0-103d-4f39-88e4-117acb0d4808', 'volume_size': 1} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:17 devstack sudo[89421]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" returned: 0 in 0.461s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:17 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 is being set with open permissions: ugo+rw Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:17 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 Apr 10 12:20:17 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:17 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-29facd30-b231-4b9e-8031-e1f920358481" returned: 0 in 0.428s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-29facd30-b231-4b9e-8031-e1f920358481" released by "delete_volume" :: held 0.972s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Created reservations ['b5543847-d27e-4058-ab1d-8f29d5f33888', '4ca4ee28-0706-4d1f-a205-45aa48a34b0d', '7731f8b2-efcf-46ba-9ea6-9155d74ec8c1', 'c21f4f02-b3ad-4714-965c-8628c8498346'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:17 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:17 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:17 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:17 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" returned: 0 in 0.426s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.633s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-459054975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=687d08d0-103d-4f39-88e4-117acb0d4808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600ecfd5ad5243a3baed4929129a32b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:17Z,use_quota=True,user_id='eebe0673a1a243fbb97119588a6be2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Creating volume 687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:18 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:18 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b84c8445-a589-4590-8f8c-d6a26e295878 tempest-VolumesSnapshotListTestJSON-1770888340 None] Create snapshot completed successfully Apr 10 12:20:18 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 1073741824 Apr 10 12:20:18 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:18 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.428s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:18 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Deleted volume successfully. Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-59b5dd03-088e-4ead-9228-3f7f4d7be779 tempest-VolumesGetTest-404837712 None] Lock "cinder-29facd30-b231-4b9e-8031-e1f920358481-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:18 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 1073741824" returned: 0 in 0.508s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:18 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 Apr 10 12:20:18 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-5de39ca6-17c2-4707-9068-8f288b328072-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Lock "cinder-5de39ca6-17c2-4707-9068-8f288b328072-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:18 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808" returned: 0 in 0.435s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:18 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5789167-bc38-4dae-a986-07fbfcbbf8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-687d08d0-103d-4f39-88e4-117acb0d4808', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b145a8d-77f6-4679-88c2-7951960b8859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-5de39ca6-17c2-4707-9068-8f288b328072" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:19 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Volume volume-687d08d0-103d-4f39-88e4-117acb0d4808 (687d08d0-103d-4f39-88e4-117acb0d4808): created successfully Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b145a8d-77f6-4679-88c2-7951960b8859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Flow 'volume_create_manager' (c9c5d5a7-0071-410f-94a9-cb90b0b18841) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:19 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2c842063-c3dc-43f0-998d-de353f5db30d tempest-VolumeDependencyTests-267471377 None] Created volume successfully. Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-5de39ca6-17c2-4707-9068-8f288b328072" acquired by "delete_volume" :: waited 0.027s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[43186d5b-d267-4637-8e54-ac4aa5cfcffb]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:19 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 Apr 10 12:20:19 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Creating offline snapshot a1f81b9f-d006-45e8-a96f-be2c628c8c3d of volume 350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c14ea8-6869-4496-8108-afd57b7ab395]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:19 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 Apr 10 12:20:19 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:19 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072" returned: 0 in 0.544s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:19 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072 Apr 10 12:20:19 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Flow 'volume_create_manager' (297e1fe1-2295-41de-a564-e442173dad7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077d6c65-c84d-4788-9ea9-ee69bd4297a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077d6c65-c84d-4788-9ea9-ee69bd4297a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-132931662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410f0f04-53ea-498b-994c-df0b33de67d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='600ecfd5ad5243a3baed4929129a32b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=687d08d0-103d-4f39-88e4-117acb0d4808,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:20Z,use_quota=True,user_id='eebe0673a1a243fbb97119588a6be2ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffc906c-134a-40e8-bccc-d644f83a43a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dffc906c-134a-40e8-bccc-d644f83a43a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ec5e36-21ad-4c38-b569-b29f6fb66094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16ec5e36-21ad-4c38-b569-b29f6fb66094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '410f0f04-53ea-498b-994c-df0b33de67d6', 'volume_name': 'volume-410f0f04-53ea-498b-994c-df0b33de67d6', 'volume_size': 1, 'source_volid': '687d08d0-103d-4f39-88e4-117acb0d4808', 'source_volstatus': 'available'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3410df3-25bc-4178-8e6c-521a3f9a6cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3410df3-25bc-4178-8e6c-521a3f9a6cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4cf424-02bf-4863-ab13-411030a4a305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:19 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Volume 410f0f04-53ea-498b-994c-df0b33de67d6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-410f0f04-53ea-498b-994c-df0b33de67d6', 'volume_size': 1, 'source_volid': '687d08d0-103d-4f39-88e4-117acb0d4808', 'source_volstatus': 'available'} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:19 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" returned: 0 in 0.546s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:19 devstack sudo[89460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d 1G Apr 10 12:20:19 devstack sudo[89460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:20 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5de39ca6-17c2-4707-9068-8f288b328072" returned: 0 in 0.445s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-5de39ca6-17c2-4707-9068-8f288b328072" released by "delete_volume" :: held 1.019s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Created reservations ['2156c4fd-28c7-4ecd-ad4b-6efa55dc30c9', '8aeb7079-7841-475d-a72a-e496f1858058', 'c7909740-3c4f-4236-a5fb-440a217c3e1f', '83ddb9d8-0127-41da-8681-383a5c3e485e'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:20 devstack sudo[89465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:20 devstack sudo[89465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:20 devstack sudo[89460]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d 1G" returned: 0 in 0.538s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:20 devstack sudo[89468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d Apr 10 12:20:20 devstack sudo[89468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:20 devstack sudo[89465]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.455s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:20 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Deleted volume successfully. Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bbbe587d-4289-4f00-8575-8d8fb825b3bc tempest-VolumesGetTest-404837712 None] Lock "cinder-5de39ca6-17c2-4707-9068-8f288b328072-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:20 devstack sudo[89468]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d" returned: 0 in 0.431s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:20 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d is being set with open permissions: ugo+rw Apr 10 12:20:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:20 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d Apr 10 12:20:20 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:21 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d" returned: 0 in 0.436s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.447s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:21 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Cloning volume 687d08d0-103d-4f39-88e4-117acb0d4808 to volume 410f0f04-53ea-498b-994c-df0b33de67d6 Apr 10 12:20:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-cbdc76bb-1b82-418c-8f02-f11dcff5c4cf tempest-VolumesSnapshotListTestJSON-1770888340 None] Create snapshot completed successfully Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Creating offline snapshot 9cd02ae4-27e7-45d0-8b98-136862ac0db2 of volume 687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c452542-8eb0-4c80-810c-99674c107810]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:21 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 Apr 10 12:20:21 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (fca24032-c0b2-4c08-8b2e-acccdd2db515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3186de71-db89-46e2-9aef-9f4dd31a83ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3186de71-db89-46e2-9aef-9f4dd31a83ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-30301908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:21Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa314e4-b134-4913-b086-a2f096fe4686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aa314e4-b134-4913-b086-a2f096fe4686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691a5a9a-a91b-4757-ae1f-66bbf77a327a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (691a5a9a-a91b-4757-ae1f-66bbf77a327a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3', 'volume_name': 'volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4fb661-9955-469f-9dd9-d4035ab872be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4fb661-9955-469f-9dd9-d4035ab872be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c603600-37cb-426e-b34f-409ed59040d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:21 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Volume 47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3', 'volume_size': 1} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:21 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808" returned: 0 in 0.470s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:21 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 1G Apr 10 12:20:21 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:22 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 1G" returned: 0 in 0.474s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-687d08d0-103d-4f39-88e4-117acb0d4808 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:22 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-687d08d0-103d-4f39-88e4-117acb0d4808 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 Apr 10 12:20:22 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:22 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-687d08d0-103d-4f39-88e4-117acb0d4808 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2" returned: 0 in 0.445s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:22 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 is being set with open permissions: ugo+rw Apr 10 12:20:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:22 devstack sudo[89492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 Apr 10 12:20:22 devstack sudo[89492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:23 devstack sudo[89492]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2" returned: 0 in 0.440s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-a1f81b9f-d006-45e8-a96f-be2c628c8c3d-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:23 devstack sudo[89495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.info Apr 10 12:20:23 devstack sudo[89495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-a1f81b9f-d006-45e8-a96f-be2c628c8c3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-quobyte-a1f81b9f-d006-45e8-a96f-be2c628c8c3d" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-a1f81b9f-d006-45e8-a96f-be2c628c8c3d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Deleting offline snapshot a1f81b9f-d006-45e8-a96f-be2c628c8c3d of volume 350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] snapshot_file for this snap is: volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[462662c3-4ea7-430b-9df2-9b7fc30cf0aa]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:23 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d Apr 10 12:20:23 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:23 devstack sudo[89495]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.info" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:23 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.info is being set with open permissions: ugo+rw Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:23 devstack sudo[89500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.info Apr 10 12:20:23 devstack sudo[89500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:23 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d" returned: 0 in 0.463s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f42b3df-716e-402b-a0b4-b9a3020cea4e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:23 devstack sudo[89505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 Apr 10 12:20:23 devstack sudo[89505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:23 devstack sudo[89500]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.info" returned: 0 in 0.411s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-410f0f04-53ea-498b-994c-df0b33de67d6" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-410f0f04-53ea-498b-994c-df0b33de67d6" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] snapshot: 9cd02ae4-27e7-45d0-8b98-136862ac0db2, volume: 410f0f04-53ea-498b-994c-df0b33de67d6, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd09997b-4415-4243-b06e-9550a8d643ca]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:24 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 Apr 10 12:20:24 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:24 devstack sudo[89505]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:24 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d Apr 10 12:20:24 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:24 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2" returned: 0 in 0.501s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-687d08d0-103d-4f39-88e4-117acb0d4808(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[525b747f-117c-44e5-909d-859e74883ca8]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:24 devstack sudo[89522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 Apr 10 12:20:24 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:24 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:24 devstack sudo[89524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d Apr 10 12:20:24 devstack sudo[89524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:24 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808" returned: 0 in 0.497s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:24 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:25 devstack sudo[89530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 Apr 10 12:20:25 devstack sudo[89530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:25 devstack sudo[89524]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.a1f81b9f-d006-45e8-a96f-be2c628c8c3d" returned: 0 in 0.410s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-a1f81b9f-d006-45e8-a96f-be2c628c8c3d" released by "_delete_snapshot" :: held 1.886s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" released by "delete_snapshot" :: held 1.899s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Created reservations ['ed261a82-b6ac-4bdd-964e-065a6ede0ae2', 'd35abc54-ac74-4acc-a907-01380403d2c3', '781b660a-acf8-471d-bb0d-2aab4bed7104', '8c12f826-9c1b-41a3-b8fc-94cb72147b3b'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:25 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Delete snapshot completed successfully. Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-041ed7e9-9a3f-4193-92fc-0ef343368a84 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-a1f81b9f-d006-45e8-a96f-be2c628c8c3d-delete_snapshot" released by "delete_snapshot" :: held 1.977s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-7d91b75c-dcbf-4d7b-9938-1e6ee1025b90-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-7d91b75c-dcbf-4d7b-9938-1e6ee1025b90-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-quobyte-7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Deleting offline snapshot 7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 of volume 350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] snapshot_file for this snap is: volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b4eb87-b1ba-410e-b6e3-cce6c41379ce]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:25 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 Apr 10 12:20:25 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:26 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" returned: 0 in 0.967s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:26 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bec760-fbe1-42b9-be00-151efc67e56d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:26 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 Apr 10 12:20:26 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:27 devstack sudo[89530]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6" returned: 0 in 2.087s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2113e98-51b4-4068-9585-a10af2f4e8dc]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:27 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86" returned: 0 in 0.862s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:27 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 Apr 10 12:20:27 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:27 devstack sudo[89552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 Apr 10 12:20:27 devstack sudo[89552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:27 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" returned: 0 in 0.456s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:27 devstack sudo[89561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90 Apr 10 12:20:27 devstack sudo[89561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:27 devstack sudo[89552]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808" returned: 0 in 0.625s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808, size 1024.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:20:27 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Converted 1024.00 MB image at 490.41 MB/s Apr 10 12:20:27 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 is being set with open permissions: ugo+rw Apr 10 12:20:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:27 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 Apr 10 12:20:27 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:28 devstack sudo[89561]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" returned: 0 in 0.418s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-7d91b75c-dcbf-4d7b-9938-1e6ee1025b90" released by "_delete_snapshot" :: held 2.770s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" released by "delete_snapshot" :: held 2.783s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Created reservations ['2c920b74-d0bd-491d-a59d-1ac6e87299fb', '2c7e0b4a-9492-401e-9dbe-0f2f1ebb16ff', '82955800-2d0a-41ed-860e-b7df9422732e', '1a41d994-aa54-473e-90ed-9177091b801f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Delete snapshot completed successfully. Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-41550555-06cc-481a-bc0a-0cc3401bcb20 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-7d91b75c-dcbf-4d7b-9938-1e6ee1025b90-delete_snapshot" released by "delete_snapshot" :: held 2.883s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:28 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6" returned: 0 in 0.451s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-410f0f04-53ea-498b-994c-df0b33de67d6" released by "_copy_volume_from_snapshot" :: held 4.207s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-9cd02ae4-27e7-45d0-8b98-136862ac0db2" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-9cd02ae4-27e7-45d0-8b98-136862ac0db2" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Deleting offline snapshot 9cd02ae4-27e7-45d0-8b98-136862ac0db2 of volume 687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] snapshot_file for this snap is: volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a16481-905e-4fd7-972f-170b4b3440ce]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:28 devstack sudo[89568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 Apr 10 12:20:28 devstack sudo[89568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-cb25e98b-d930-40cc-9fce-2b2f87557f86-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-cb25e98b-d930-40cc-9fce-2b2f87557f86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-quobyte-cb25e98b-d930-40cc-9fce-2b2f87557f86" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-cb25e98b-d930-40cc-9fce-2b2f87557f86" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Deleting offline snapshot cb25e98b-d930-40cc-9fce-2b2f87557f86 of volume 350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] snapshot_file for this snap is: volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b1708e1-4793-4482-9850-84f995f8c9e5]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:28 devstack sudo[89570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 Apr 10 12:20:28 devstack sudo[89570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:28 devstack sudo[89568]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2" returned: 0 in 0.468s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-687d08d0-103d-4f39-88e4-117acb0d4808(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3788438-fac5-466e-8eed-1e51397bbfba]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:28 devstack sudo[89575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 Apr 10 12:20:28 devstack sudo[89575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:28 devstack sudo[89570]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86" returned: 0 in 0.492s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca723ac-4866-44d3-857d-2737596a0446]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:29 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 Apr 10 12:20:29 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:29 devstack sudo[89575]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808" returned: 0 in 0.497s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:29 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 Apr 10 12:20:29 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:29 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82" returned: 0 in 0.484s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:29 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 Apr 10 12:20:29 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:29 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2" returned: 0 in 0.446s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:29 devstack sudo[89595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2 Apr 10 12:20:29 devstack sudo[89595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:29 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:29 devstack sudo[89600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86 Apr 10 12:20:29 devstack sudo[89600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:30 devstack sudo[89595]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808.9cd02ae4-27e7-45d0-8b98-136862ac0db2" returned: 0 in 0.421s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-9cd02ae4-27e7-45d0-8b98-136862ac0db2" released by "_delete_snapshot" :: held 1.876s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.864s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.682s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-30301908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:21Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Creating volume 47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:30 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d4cf424-02bf-4863-ab13-411030a4a305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410f0f04-53ea-498b-994c-df0b33de67d6', 'volume_size': 1, 'source_volid': '687d08d0-103d-4f39-88e4-117acb0d4808', 'source_volstatus': 'available'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:30 devstack sudo[89603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 1073741824 Apr 10 12:20:30 devstack sudo[89603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baa5ec5-9d85-46f1-865f-09727b0642ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:30 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Volume volume-410f0f04-53ea-498b-994c-df0b33de67d6 (410f0f04-53ea-498b-994c-df0b33de67d6): created successfully Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2baa5ec5-9d85-46f1-865f-09727b0642ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Flow 'volume_create_manager' (297e1fe1-2295-41de-a564-e442173dad7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:30 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-80466017-5664-40ee-b0b9-c10b09a54e4c tempest-VolumeDependencyTests-267471377 None] Created volume successfully. Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-687d08d0-103d-4f39-88e4-117acb0d4808-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-687d08d0-103d-4f39-88e4-117acb0d4808-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-687d08d0-103d-4f39-88e4-117acb0d4808" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-687d08d0-103d-4f39-88e4-117acb0d4808" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[882c2bee-8ab6-4d49-a755-1f313ca066b5]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:30 devstack sudo[89600]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82.cb25e98b-d930-40cc-9fce-2b2f87557f86" returned: 0 in 0.459s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-cb25e98b-d930-40cc-9fce-2b2f87557f86" released by "_delete_snapshot" :: held 1.958s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:30 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 Apr 10 12:20:30 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" released by "delete_snapshot" :: held 1.973s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Created reservations ['72133ad4-44b5-4ea1-9901-25fd87479c5a', '5a5587e0-05b7-469f-9213-6ad1f3dc3d1c', '2bbf46fe-d1af-4373-829a-5b54430bbe76', '9f294500-746d-45d5-a43b-2b9ace72689c'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:30 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Delete snapshot completed successfully. Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9f7e5fcc-d240-4cc8-9ab2-74905c729540 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-cb25e98b-d930-40cc-9fce-2b2f87557f86-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-350d5cbd-df8b-43dc-9a79-5f1e96922a82-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-350d5cbd-df8b-43dc-9a79-5f1e96922a82-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b407d-7358-48a6-bab4-521d23545875]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:30 devstack sudo[89603]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 1073741824" returned: 0 in 0.565s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:30 devstack sudo[89611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 Apr 10 12:20:30 devstack sudo[89611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:30 devstack sudo[89612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 Apr 10 12:20:30 devstack sudo[89612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:30 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808" returned: 0 in 0.481s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:30 devstack sudo[89618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808 Apr 10 12:20:30 devstack sudo[89618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:31 devstack sudo[89611]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82" returned: 0 in 0.478s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:31 devstack sudo[89612]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" returned: 0 in 0.434s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:31 devstack sudo[89624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82 Apr 10 12:20:31 devstack sudo[89624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c603600-37cb-426e-b34f-409ed59040d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1410869-3842-4821-9e43-b1a6c733f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:31 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Volume volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 (47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3): created successfully Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1410869-3842-4821-9e43-b1a6c733f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (fca24032-c0b2-4c08-8b2e-acccdd2db515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c2fb427d-3344-4207-9070-a155df9dab29 tempest-VolumesGetTest-404837712 None] Created volume successfully. Apr 10 12:20:31 devstack sudo[89618]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-687d08d0-103d-4f39-88e4-117acb0d4808" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-687d08d0-103d-4f39-88e4-117acb0d4808" released by "delete_volume" :: held 0.936s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Created reservations ['5a21b2ef-989e-401b-9c1b-03f8b69bf7b4', 'e826b0b2-b93a-4d76-a8af-d4161f5ceb6c', 'd0bb05b9-bee8-4888-a013-9d8d17442d1f', '712e5ef0-01ed-48c4-a8bd-3b07fa447960'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:31 devstack sudo[89627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:31 devstack sudo[89627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-410f0f04-53ea-498b-994c-df0b33de67d6-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-410f0f04-53ea-498b-994c-df0b33de67d6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-410f0f04-53ea-498b-994c-df0b33de67d6" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-410f0f04-53ea-498b-994c-df0b33de67d6" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f1203c-4672-40ec-b853-d2bc6cf4854c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:31 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 Apr 10 12:20:31 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:31 devstack sudo[89624]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-350d5cbd-df8b-43dc-9a79-5f1e96922a82" returned: 0 in 0.435s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-quobyte-350d5cbd-df8b-43dc-9a79-5f1e96922a82" released by "delete_volume" :: held 0.943s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Created reservations ['25fa6d35-7769-4f9e-b771-d91706153294', '93c2e77c-d498-4cbc-a77f-1d4a6a3bf161', '2a68e3e4-b678-4b7a-8ccf-5b8c49b89c1f', 'f4b1a406-cbee-42d8-98a5-48ab52f84dec'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:31 devstack sudo[89632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:31 devstack sudo[89632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:31 devstack sudo[89627]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.465s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Deleted volume successfully. Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-8038bfc3-aafe-4dad-b40d-a4ddad825695 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-687d08d0-103d-4f39-88e4-117acb0d4808-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:31 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6" returned: 0 in 0.537s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:31 devstack sudo[89638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6 Apr 10 12:20:31 devstack sudo[89638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:32 devstack sudo[89632]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.450s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:32 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Deleted volume successfully. Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9e846570-0743-404b-93a6-52e6ab612e81 tempest-VolumesSnapshotListTestJSON-1770888340 None] Lock "cinder-350d5cbd-df8b-43dc-9a79-5f1e96922a82-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (5bd7794f-233a-4cc1-a161-026afb98d072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b0198f-c81e-4ded-8543-618e298a9425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0b0198f-c81e-4ded-8543-618e298a9425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1880102123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4977a7b9-a269-4c91-9c34-8dc1aca73e35,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:32Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e2b597-45c0-4076-afb7-7862895857f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e2b597-45c0-4076-afb7-7862895857f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac940d5-c046-4c0d-a4c2-824fd16bfd11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bac940d5-c046-4c0d-a4c2-824fd16bfd11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4977a7b9-a269-4c91-9c34-8dc1aca73e35', 'volume_name': 'volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35', 'volume_size': 1, 'source_volid': '47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3', 'source_volstatus': 'available'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe4c93c-9147-45a3-871d-b2a4bd799743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe4c93c-9147-45a3-871d-b2a4bd799743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333cadcf-c59f-49fc-90bc-fe4286aca6ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:32 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Volume 4977a7b9-a269-4c91-9c34-8dc1aca73e35: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35', 'volume_size': 1, 'source_volid': '47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3', 'source_volstatus': 'available'} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:32 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Cloning volume 47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 to volume 4977a7b9-a269-4c91-9c34-8dc1aca73e35 Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Creating offline snapshot 35fbc31e-a32f-48c6-abe0-dfce6a50fac6 of volume 47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64a915-9bed-4a68-8c5e-7aa688fd0360]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:32 devstack sudo[89638]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-410f0f04-53ea-498b-994c-df0b33de67d6" returned: 0 in 0.492s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-410f0f04-53ea-498b-994c-df0b33de67d6" released by "delete_volume" :: held 1.053s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Created reservations ['8c6443da-2e05-4e00-8782-670e2c6b3432', '9727b448-9c76-4e3f-91b5-98f57ec9cf69', '52ae17ca-313d-4d9b-8dc5-26a54e27a548', 'b3303aeb-7aea-4863-a378-4a1e4bd276ac'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:32 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 Apr 10 12:20:32 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:32 devstack sudo[89644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:32 devstack sudo[89644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:32 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" returned: 0 in 0.524s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:32 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 1G Apr 10 12:20:32 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:33 devstack sudo[89644]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:33 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Deleted volume successfully. Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bb480849-7fcb-444e-bc28-e7d137ca4f94 tempest-VolumeDependencyTests-267471377 None] Lock "cinder-410f0f04-53ea-498b-994c-df0b33de67d6-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (21cf9306-4225-40df-82db-605d61254635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3743d49-8f2b-4afb-a035-e0cc5e592f56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3743d49-8f2b-4afb-a035-e0cc5e592f56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-894593843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07c49e8-d6cb-4484-ba76-0d48febe7060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:33Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1407700c-063e-4a5a-9d3f-6e1ff7eea4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1407700c-063e-4a5a-9d3f-6e1ff7eea4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22297b10-ed98-48b0-8ef8-8271ee804d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22297b10-ed98-48b0-8ef8-8271ee804d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c07c49e8-d6cb-4484-ba76-0d48febe7060', 'volume_name': 'volume-c07c49e8-d6cb-4484-ba76-0d48febe7060', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1285d000-a9ac-4176-9f4e-3b7e0b55f416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1285d000-a9ac-4176-9f4e-3b7e0b55f416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8579987f-9ccd-4cd7-9c4a-f29751a75a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:33 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume c07c49e8-d6cb-4484-ba76-0d48febe7060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c07c49e8-d6cb-4484-ba76-0d48febe7060', 'volume_size': 1} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:33 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 1G" returned: 0 in 0.576s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:33 devstack sudo[89655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 Apr 10 12:20:33 devstack sudo[89655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-0054c370-6f27-475a-8610-a2315a28c15c-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Lock "cinder-0054c370-6f27-475a-8610-a2315a28c15c-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Acquiring lock "cinder-quobyte-0054c370-6f27-475a-8610-a2315a28c15c" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-0054c370-6f27-475a-8610-a2315a28c15c" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91dab63-40a0-4f55-9e44-d716affd0339]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:33 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c Apr 10 12:20:33 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:33 devstack sudo[89655]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6" returned: 0 in 0.448s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:33 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 is being set with open permissions: ugo+rw Apr 10 12:20:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:34 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 Apr 10 12:20:34 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:34 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c" returned: 0 in 0.470s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:34 devstack sudo[89668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c Apr 10 12:20:34 devstack sudo[89668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:34 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6" returned: 0 in 0.437s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:34 devstack sudo[89672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.info Apr 10 12:20:34 devstack sudo[89672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:34 devstack sudo[89668]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-0054c370-6f27-475a-8610-a2315a28c15c" returned: 0 in 0.427s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Lock "cinder-quobyte-0054c370-6f27-475a-8610-a2315a28c15c" released by "delete_volume" :: held 0.918s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Created reservations ['5db0f085-c496-4cc6-bc43-6c7030ea788a', '78a02520-96c2-473d-b8ef-ca62e9cd82bb', '55a7524d-b3a8-4390-a685-5f73860f72f8', '2ed1f6d1-482d-4b06-987c-7e75161b31b0'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:34 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:34 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:34 devstack sudo[89672]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.info" returned: 0 in 0.430s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:34 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.info is being set with open permissions: ugo+rw Apr 10 12:20:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:34 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.info Apr 10 12:20:34 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:35 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.436s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:35 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Deleted volume successfully. Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bf5c6439-a1a9-4c81-aadb-57077798c3aa tempest-VolumeDependencyTests-267471377 None] Lock "cinder-0054c370-6f27-475a-8610-a2315a28c15c-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:35 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.info" returned: 0 in 0.489s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-4977a7b9-a269-4c91-9c34-8dc1aca73e35" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-4977a7b9-a269-4c91-9c34-8dc1aca73e35" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] snapshot: 35fbc31e-a32f-48c6-abe0-dfce6a50fac6, volume: 4977a7b9-a269-4c91-9c34-8dc1aca73e35, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[68de042a-b60a-4400-88c6-730bb0059bb1]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:35 devstack sudo[89681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 Apr 10 12:20:35 devstack sudo[89681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:35 devstack sudo[89681]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d286860a-83c2-492f-9734-bdd0073fdd7c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:35 devstack sudo[89686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 Apr 10 12:20:35 devstack sudo[89686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:36 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=198,cinder:INSERT=72,cinder:UPDATE=236,cinder:DELETE=27 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:20:36 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=186,cinder:INSERT=62,cinder:UPDATE=267,cinder:DELETE=16 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:20:36 devstack sudo[89686]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" returned: 0 in 0.462s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:36 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:20:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:36 devstack sudo[89691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 Apr 10 12:20:36 devstack sudo[89691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:38 devstack sudo[89691]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35" returned: 0 in 1.992s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:38 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf65640-14be-41bd-bff1-5c48b4b6393d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:38 devstack sudo[89704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 Apr 10 12:20:38 devstack sudo[89704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:39 devstack sudo[89704]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" returned: 0 in 0.617s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3, size 1024.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:20:39 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Converted 1024.00 MB image at 513.72 MB/s Apr 10 12:20:39 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 is being set with open permissions: ugo+rw Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:39 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 Apr 10 12:20:39 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:39 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35" returned: 0 in 0.395s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-4977a7b9-a269-4c91-9c34-8dc1aca73e35" released by "_copy_volume_from_snapshot" :: held 4.030s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-35fbc31e-a32f-48c6-abe0-dfce6a50fac6" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-35fbc31e-a32f-48c6-abe0-dfce6a50fac6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Deleting offline snapshot 35fbc31e-a32f-48c6-abe0-dfce6a50fac6 of volume 47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] snapshot_file for this snap is: volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[47756ca5-b7ff-4209-a0e3-01ba74749606]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:39 devstack sudo[89713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 Apr 10 12:20:39 devstack sudo[89713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:39 devstack sudo[89713]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6" returned: 0 in 0.475s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[404bc239-1d33-4f7d-a31f-6df91d21c53f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:40 devstack sudo[89718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 Apr 10 12:20:40 devstack sudo[89718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:40 devstack sudo[89718]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:40 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 Apr 10 12:20:40 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:40 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6" returned: 0 in 0.461s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:40 devstack sudo[89728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6 Apr 10 12:20:40 devstack sudo[89728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:41 devstack sudo[89728]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3.35fbc31e-a32f-48c6-abe0-dfce6a50fac6" returned: 0 in 0.401s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-35fbc31e-a32f-48c6-abe0-dfce6a50fac6" released by "_delete_snapshot" :: held 1.860s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.914s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.782s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-894593843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c07c49e8-d6cb-4484-ba76-0d48febe7060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:33Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Creating volume c07c49e8-d6cb-4484-ba76-0d48febe7060 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:41 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (333cadcf-c59f-49fc-90bc-fe4286aca6ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35', 'volume_size': 1, 'source_volid': '47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3', 'source_volstatus': 'available'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:41 devstack sudo[89731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 1073741824 Apr 10 12:20:41 devstack sudo[89731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1669e8d0-2372-4bf5-a58d-81751aa656d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Volume volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 (4977a7b9-a269-4c91-9c34-8dc1aca73e35): created successfully Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1669e8d0-2372-4bf5-a58d-81751aa656d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (5bd7794f-233a-4cc1-a161-026afb98d072) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-52fd0d1d-c736-423e-af54-039996ae5297 tempest-VolumesGetTest-404837712 None] Created volume successfully. Apr 10 12:20:41 devstack sudo[89731]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 1073741824" returned: 0 in 0.509s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:41 devstack sudo[89736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 Apr 10 12:20:41 devstack sudo[89736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (8635cbe1-8209-4656-af4c-732eebb7febc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47cd4c5-96b5-483d-affb-08a0f2e6e14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47cd4c5-96b5-483d-affb-08a0f2e6e14b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1731647903',display_name='tempest-VolumesGetTest-Volume-1307049536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7308fba0-39e1-46e7-b3b3-ae553cfd0e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:42Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d8600c-8659-4a1f-85d2-98ef7b87e19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d8600c-8659-4a1f-85d2-98ef7b87e19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ba4af2-d80a-4e68-b4e6-784f351aa5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10ba4af2-d80a-4e68-b4e6-784f351aa5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7308fba0-39e1-46e7-b3b3-ae553cfd0e1d', 'volume_name': 'volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b86a1dd-ce5d-43ad-8624-8a8c4aeea4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b86a1dd-ce5d-43ad-8624-8a8c4aeea4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7930efab-b4a1-482a-970b-b4d9a716ac91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:42 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Volume 7308fba0-39e1-46e7-b3b3-ae553cfd0e1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d', 'volume_size': 1} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:42 devstack sudo[89736]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060" returned: 0 in 0.461s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.042s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1731647903',display_name='tempest-VolumesGetTest-Volume-1307049536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7308fba0-39e1-46e7-b3b3-ae553cfd0e1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:42Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Creating volume 7308fba0-39e1-46e7-b3b3-ae553cfd0e1d {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:42 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8579987f-9ccd-4cd7-9c4a-f29751a75a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c07c49e8-d6cb-4484-ba76-0d48febe7060', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b4d812-b836-4b05-a53f-b050a2324040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:42 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d 1073741824 Apr 10 12:20:42 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:42 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 (c07c49e8-d6cb-4484-ba76-0d48febe7060): created successfully Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b4d812-b836-4b05-a53f-b050a2324040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (21cf9306-4225-40df-82db-605d61254635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:42 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-014f4b44-78f0-4569-8ddf-14f418171967 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created volume successfully. Apr 10 12:20:42 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d 1073741824" returned: 0 in 0.473s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:42 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d Apr 10 12:20:42 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:43 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.244s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7930efab-b4a1-482a-970b-b4d9a716ac91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff82b5db-dd82-4ef8-9890-aa114714875e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Creating offline snapshot 165ffcab-16c4-479c-b14c-e6522f175293 of volume c07c49e8-d6cb-4484-ba76-0d48febe7060 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:20:43 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Volume volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d (7308fba0-39e1-46e7-b3b3-ae553cfd0e1d): created successfully Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff82b5db-dd82-4ef8-9890-aa114714875e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (8635cbe1-8209-4656-af4c-732eebb7febc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f33b98-d20f-4279-8a36-76f1967b86fb]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:43 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0bb16f44-8389-4ec7-bc3b-f5bb5b98e43f tempest-VolumesGetTest-404837712 None] Created volume successfully. Apr 10 12:20:43 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 Apr 10 12:20:43 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:43 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060" returned: 0 in 0.461s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:43 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 1G Apr 10 12:20:43 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:44 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 1G" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:44 devstack sudo[89764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 Apr 10 12:20:44 devstack sudo[89764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Lock "cinder-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2732572c-42b2-465a-b47c-09dd7c59aecf]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:44 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d Apr 10 12:20:44 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:44 devstack sudo[89764]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293" returned: 0 in 0.433s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:44 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 is being set with open permissions: ugo+rw Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:44 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 Apr 10 12:20:44 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:44 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d" returned: 0 in 0.471s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:44 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d Apr 10 12:20:44 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:45 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293" returned: 0 in 0.440s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:45 devstack sudo[89779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.info Apr 10 12:20:45 devstack sudo[89779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:45 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d" returned: 0 in 0.433s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d" released by "delete_volume" :: held 0.925s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Created reservations ['2a2871b9-1e74-460c-b5c3-68bb2b0f10a8', '982d4811-993f-4df0-86f4-7a5c5c544110', '220fb80d-7efc-4315-a2df-42fd1a0e9a5b', '6f7f43d2-9ba5-4d85-bce7-60e56565888b'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:45 devstack sudo[89782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:45 devstack sudo[89782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:45 devstack sudo[89779]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-4977a7b9-a269-4c91-9c34-8dc1aca73e35-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.info" returned: 0 in 0.443s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:45 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.info is being set with open permissions: ugo+rw Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Lock "cinder-4977a7b9-a269-4c91-9c34-8dc1aca73e35-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:45 devstack sudo[89785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.info Apr 10 12:20:45 devstack sudo[89785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-4977a7b9-a269-4c91-9c34-8dc1aca73e35" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-4977a7b9-a269-4c91-9c34-8dc1aca73e35" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b071b5b4-46bd-4921-a67d-4e600a7f1f4a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:45 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 Apr 10 12:20:45 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:45 devstack sudo[89782]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.439s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:45 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Deleted volume successfully. Apr 10 12:20:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-43c8984e-b43d-4969-9227-d2e1992a30ba tempest-VolumesGetTest-404837712 None] Lock "cinder-7308fba0-39e1-46e7-b3b3-ae553cfd0e1d-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:46 devstack sudo[89785]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.info" returned: 0 in 0.445s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.771s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-361c4ae7-2096-447d-9512-018ced6b3c45 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Create snapshot completed successfully Apr 10 12:20:46 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:46 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35 Apr 10 12:20:46 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (20d4869e-2408-41dc-954c-8afae7dbd3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c73d767-860a-4714-b479-aba948e7798c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c73d767-860a-4714-b479-aba948e7798c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-775013260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e7c61d-db8c-45c9-a197-24af4812a70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:46Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7719c77c-6ef2-4676-b1a9-1a3514361920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7719c77c-6ef2-4676-b1a9-1a3514361920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f8e6cc-e705-4035-b464-1e5fa8bf0f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f8e6cc-e705-4035-b464-1e5fa8bf0f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49e7c61d-db8c-45c9-a197-24af4812a70e', 'volume_name': 'volume-49e7c61d-db8c-45c9-a197-24af4812a70e', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a223cd5-09fd-479c-b923-fb1895539512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a223cd5-09fd-479c-b923-fb1895539512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d02334f-1294-49db-9b29-e02c149bf296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume 49e7c61d-db8c-45c9-a197-24af4812a70e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49e7c61d-db8c-45c9-a197-24af4812a70e', 'volume_size': 1} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-775013260',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49e7c61d-db8c-45c9-a197-24af4812a70e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:46Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Creating volume 49e7c61d-db8c-45c9-a197-24af4812a70e {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:46 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:46 devstack sudo[89796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e 1073741824 Apr 10 12:20:46 devstack sudo[89796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (964a1c09-2fbd-4a66-91a8-0a1828f18907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f6295b-c2e1-401d-bb31-b8366bf7a8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8f6295b-c2e1-401d-bb31-b8366bf7a8a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-474091053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af5d2b3-593b-4c81-bacd-549d40290b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:47Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27de683c-1db7-43bd-9406-24aef549f613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27de683c-1db7-43bd-9406-24aef549f613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423d13f5-1529-46c3-a222-cba44d37b1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423d13f5-1529-46c3-a222-cba44d37b1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2af5d2b3-593b-4c81-bacd-549d40290b27', 'volume_name': 'volume-2af5d2b3-593b-4c81-bacd-549d40290b27', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d57af28-b396-4e46-86cc-33f5e7c1b197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d57af28-b396-4e46-86cc-33f5e7c1b197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c85ad2-396b-42c8-ab93-d9785da3015e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume 2af5d2b3-593b-4c81-bacd-549d40290b27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2af5d2b3-593b-4c81-bacd-549d40290b27', 'volume_size': 1} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4977a7b9-a269-4c91-9c34-8dc1aca73e35" returned: 0 in 0.459s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-4977a7b9-a269-4c91-9c34-8dc1aca73e35" released by "delete_volume" :: held 0.976s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Created reservations ['ca33ab2d-10dd-4e1e-b6e9-53e04ba993f0', '19800169-9efb-4d2d-bee9-b1944eeeab22', '52792746-fa99-418b-b2b2-b900e7f42a95', '7c76659e-dd3b-4562-a4d8-c6f489aa2d79'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:46 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:46 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (7d331288-d23f-45b8-a7fe-40df92dfb708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfb9143-c864-4156-b974-25d46335e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cfb9143-c864-4156-b974-25d46335e407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615898719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136542bb-c550-42aa-9f4b-99e23d4f88b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:47Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d926d76-6a73-4ca5-ad4f-9730510a2051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d926d76-6a73-4ca5-ad4f-9730510a2051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23d0696-5a93-404a-80c7-fb3f7915ab5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f23d0696-5a93-404a-80c7-fb3f7915ab5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '136542bb-c550-42aa-9f4b-99e23d4f88b3', 'volume_name': 'volume-136542bb-c550-42aa-9f4b-99e23d4f88b3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9287f42a-57d3-47ab-9a6c-83512f65d66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9287f42a-57d3-47ab-9a6c-83512f65d66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62dedea3-4c3f-448d-a142-5150a6d73308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:46 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume 136542bb-c550-42aa-9f4b-99e23d4f88b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-136542bb-c550-42aa-9f4b-99e23d4f88b3', 'volume_size': 1} Apr 10 12:20:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (0e769f3a-b64a-432d-ac26-9f883489e231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c034dfcb-6d3c-4290-a01f-44a3bdf30c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c034dfcb-6d3c-4290-a01f-44a3bdf30c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1073082322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e28e6bf-3442-4b03-9cd5-fda15e40c9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:47Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1805fbc2-8bc5-4780-9685-98a0acaab9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1805fbc2-8bc5-4780-9685-98a0acaab9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6010c6a3-bd3f-4636-b7ac-955e1c6d492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6010c6a3-bd3f-4636-b7ac-955e1c6d492a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e28e6bf-3442-4b03-9cd5-fda15e40c9c8', 'volume_name': 'volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa90c6e7-201d-4e2d-bad0-e1d11a87d9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa90c6e7-201d-4e2d-bad0-e1d11a87d9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5b1098-4cdd-4ad9-bca3-f0841dbf1370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume 8e28e6bf-3442-4b03-9cd5-fda15e40c9c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8', 'volume_size': 1} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:47 devstack sudo[89796]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e 1073741824" returned: 0 in 0.648s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:47 devstack sudo[89805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e Apr 10 12:20:47 devstack sudo[89805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:47 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Deleted volume successfully. Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7bdb944c-df3a-402f-b339-84874886aac4 tempest-VolumesGetTest-404837712 None] Lock "cinder-4977a7b9-a269-4c91-9c34-8dc1aca73e35-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (f8fc9f72-38b1-49b1-ba06-b428c1eb0382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e369f8-c926-4e64-9680-1bad35f13d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e369f8-c926-4e64-9680-1bad35f13d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30391713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495975c7-71c5-4f83-bc7c-a0276358bb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:47Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9080322d-f408-48bb-8623-85ac8a9aa81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9080322d-f408-48bb-8623-85ac8a9aa81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8d4fa4-a068-4f1c-99b3-0fadd884d897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8d4fa4-a068-4f1c-99b3-0fadd884d897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '495975c7-71c5-4f83-bc7c-a0276358bb45', 'volume_name': 'volume-495975c7-71c5-4f83-bc7c-a0276358bb45', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ccb09c-437b-4fbf-b9de-6fa6dbe985fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84ccb09c-437b-4fbf-b9de-6fa6dbe985fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac7876b-7c18-4851-964f-b7578ef705ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume 495975c7-71c5-4f83-bc7c-a0276358bb45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-495975c7-71c5-4f83-bc7c-a0276358bb45', 'volume_size': 1} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:47 devstack sudo[89805]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e" returned: 0 in 0.440s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-474091053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2af5d2b3-593b-4c81-bacd-549d40290b27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:47Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Creating volume 2af5d2b3-593b-4c81-bacd-549d40290b27 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:47 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d02334f-1294-49db-9b29-e02c149bf296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49e7c61d-db8c-45c9-a197-24af4812a70e', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack sudo[89808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 1073741824 Apr 10 12:20:47 devstack sudo[89808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d48a34-31ff-44ff-85eb-7ebd87adb75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:47 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume volume-49e7c61d-db8c-45c9-a197-24af4812a70e (49e7c61d-db8c-45c9-a197-24af4812a70e): created successfully Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d48a34-31ff-44ff-85eb-7ebd87adb75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (20d4869e-2408-41dc-954c-8afae7dbd3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:47 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c7584848-e6d8-4c55-bc51-7c8f0cd863a4 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created volume successfully. Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Lock "cinder-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df7e61f-5cf4-4f6c-9e95-8c1717849c8f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:47 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:47 devstack sudo[89810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 Apr 10 12:20:47 devstack sudo[89810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:48 devstack sudo[89808]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 1073741824" returned: 0 in 0.528s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:48 devstack sudo[89815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 Apr 10 12:20:48 devstack sudo[89815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:48 devstack sudo[89810]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" returned: 0 in 0.500s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:48 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3 Apr 10 12:20:48 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:48 devstack sudo[89815]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27" returned: 0 in 0.433s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-615898719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=136542bb-c550-42aa-9f4b-99e23d4f88b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:47Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Creating volume 136542bb-c550-42aa-9f4b-99e23d4f88b3 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:48 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9c85ad2-396b-42c8-ab93-d9785da3015e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2af5d2b3-593b-4c81-bacd-549d40290b27', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:48 devstack sudo[89823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 1073741824 Apr 10 12:20:48 devstack sudo[89823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11bd0fa-0b01-4f27-ac34-f5b2873f2b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:48 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume volume-2af5d2b3-593b-4c81-bacd-549d40290b27 (2af5d2b3-593b-4c81-bacd-549d40290b27): created successfully Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e11bd0fa-0b01-4f27-ac34-f5b2873f2b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (964a1c09-2fbd-4a66-91a8-0a1828f18907) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:48 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-5e684aff-3748-4535-b62e-86f444227327 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created volume successfully. Apr 10 12:20:48 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" returned: 0 in 0.416s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3" released by "delete_volume" :: held 0.948s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Created reservations ['e6642427-afb4-440f-882b-3f6e9e40cc98', '2f23c652-b95b-4791-af3a-d5b467969f33', '2f3aa374-14ca-4d38-b0e3-3358b8830e71', 'abc5a2f6-344c-44be-a83c-dab68108826d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:48 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:48 devstack sudo[89826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:48 devstack sudo[89826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:49 devstack sudo[89823]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 1073741824" returned: 0 in 0.518s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:49 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 Apr 10 12:20:49 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (c324f985-6ed4-441c-a974-72158a1ae1a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd70f21-181b-4fd1-9aa8-13592e1c8197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd70f21-181b-4fd1-9aa8-13592e1c8197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1145523219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd93385d-52ea-4af2-872c-fba9453738de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:49Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:49 devstack sudo[89826]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23829de2-48ad-4f1a-8f57-29cc11477416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23829de2-48ad-4f1a-8f57-29cc11477416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8c954e-0fc8-4493-a982-2f8a7e23b645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.image.glance [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Creating Keystone auth plugin from conf {{(pid=82546) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.507s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:49 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Deleted volume successfully. Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-00458cac-ea3a-4ce3-8820-7a5f174ebe25 tempest-VolumesGetTest-404837712 None] Lock "cinder-47d3ca6c-ea92-44c0-b7fc-9fe7e2b938a3-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:49 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3" returned: 0 in 0.450s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.472s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1073082322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e28e6bf-3442-4b03-9cd5-fda15e40c9c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:47Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Creating volume 8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:49 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:49 devstack sudo[89835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 1073741824 Apr 10 12:20:49 devstack sudo[89835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62dedea3-4c3f-448d-a142-5150a6d73308) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-136542bb-c550-42aa-9f4b-99e23d4f88b3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1a9926-645b-43c8-af02-f809991c8660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:49 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 (136542bb-c550-42aa-9f4b-99e23d4f88b3): created successfully Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b1a9926-645b-43c8-af02-f809991c8660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (7d331288-d23f-45b8-a7fe-40df92dfb708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:49 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7aff02d5-2f8c-4102-b925-9b183395d5d3 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created volume successfully. Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db8c954e-0fc8-4493-a982-2f8a7e23b645) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cd93385d-52ea-4af2-872c-fba9453738de', 'volume_name': 'volume-cd93385d-52ea-4af2-872c-fba9453738de', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57a0a26-0cd6-4e7a-a25f-7dbe725f00ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f57a0a26-0cd6-4e7a-a25f-7dbe725f00ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097ed209-b122-4b6a-b6c5-2364fade005d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:49 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Volume cd93385d-52ea-4af2-872c-fba9453738de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cd93385d-52ea-4af2-872c-fba9453738de', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Trying to clone cd93385d-52ea-4af2-872c-fba9453738de from image 35717e41-b49c-4e85-9a50-2d2207b8655c at location (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]). {{(pid=82546) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 10 12:20:49 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Image download 20.69 MB at 20.69 MB/s Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b17f58-0e14-4713-8885-c025529e74ae]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:49 devstack sudo[89838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD Apr 10 12:20:49 devstack sudo[89838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:50 devstack sudo[89835]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 1073741824" returned: 0 in 0.552s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:50 devstack sudo[89843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 Apr 10 12:20:50 devstack sudo[89843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:50 devstack sudo[89838]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Temporary image 35717e41-b49c-4e85-9a50-2d2207b8655c is fetched for user a6d07908ea3c4ac39d655925076eca71. {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[acdf3b91-c954-4294-babf-b88336998e63]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:50 devstack sudo[89848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD Apr 10 12:20:50 devstack sudo[89848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:50 devstack sudo[89843]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8" returned: 0 in 0.446s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.306s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-30391713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=495975c7-71c5-4f83-bc7c-a0276358bb45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0b0d7ced444456c8d8ebf970f5114c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:47Z,use_quota=True,user_id='6742d08e8352414e98b15660af7a5418',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Creating volume 495975c7-71c5-4f83-bc7c-a0276358bb45 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:50 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5b1098-4cdd-4ad9-bca3-f0841dbf1370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:50 devstack sudo[89851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 1073741824 Apr 10 12:20:50 devstack sudo[89851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2519b65f-33da-4aad-b348-612e77c5ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:50 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 (8e28e6bf-3442-4b03-9cd5-fda15e40c9c8): created successfully Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2519b65f-33da-4aad-b348-612e77c5ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (0e769f3a-b64a-432d-ac26-9f883489e231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e7a35124-4494-43f2-8d13-065701cbb586 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created volume successfully. Apr 10 12:20:50 devstack sudo[89848]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD" returned: 0 in 0.459s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:51 devstack sudo[89851]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 1073741824" returned: 0 in 0.466s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:51 devstack sudo[89859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 Apr 10 12:20:51 devstack sudo[89859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:51 devstack sudo[89859]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45" returned: 0 in 0.412s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.662s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1145523219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd93385d-52ea-4af2-872c-fba9453738de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:49Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Creating volume cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:51 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:51 devstack sudo[89874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de 1073741824 Apr 10 12:20:51 devstack sudo[89874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac7876b-7c18-4851-964f-b7578ef705ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-495975c7-71c5-4f83-bc7c-a0276358bb45', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb57fc53-c1a0-4e73-ab63-610d8015632a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:51 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Volume volume-495975c7-71c5-4f83-bc7c-a0276358bb45 (495975c7-71c5-4f83-bc7c-a0276358bb45): created successfully Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb57fc53-c1a0-4e73-ab63-610d8015632a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:51 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Flow 'volume_create_manager' (f8fc9f72-38b1-49b1-ba06-b428c1eb0382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:51 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e991fad2-2cdd-4df3-8a97-bd04aa7bb975 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created volume successfully. Apr 10 12:20:52 devstack sudo[89874]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de 1073741824" returned: 0 in 0.483s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:52 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de Apr 10 12:20:52 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:52 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de" returned: 0 in 0.421s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Attempting download of 35717e41-b49c-4e85-9a50-2d2207b8655c ((None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}])) to volume cd93385d-52ea-4af2-872c-fba9453738de. {{(pid=82546) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d1c22d-e9a1-4f91-9c73-36844e7907fd]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_qao9jmrq {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:52 devstack sudo[89904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_qao9jmrq Apr 10 12:20:52 devstack sudo[89904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-495975c7-71c5-4f83-bc7c-a0276358bb45-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-495975c7-71c5-4f83-bc7c-a0276358bb45-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-quobyte-495975c7-71c5-4f83-bc7c-a0276358bb45" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-495975c7-71c5-4f83-bc7c-a0276358bb45" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc499d17-2e94-496f-9779-3651ca7b47b9]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:52 devstack sudo[89906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 Apr 10 12:20:52 devstack sudo[89906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:52 devstack sudo[89904]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_qao9jmrq" returned: 0 in 0.462s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_qao9jmrq {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:53 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_qao9jmrq Apr 10 12:20:53 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:53 devstack sudo[89906]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45" returned: 0 in 0.465s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:53 devstack sudo[89915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45 Apr 10 12:20:53 devstack sudo[89915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:53 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_qao9jmrq" returned: 1 in 0.448s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_35717e41-b49c-4e85-9a50-2d2207b8655c_qao9jmrq' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[4230b9fd-f266-4985-8b12-e212e04de4ac]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:53 devstack sudo[89919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD Apr 10 12:20:53 devstack sudo[89919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:53 devstack sudo[89915]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-495975c7-71c5-4f83-bc7c-a0276358bb45" returned: 0 in 0.417s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-495975c7-71c5-4f83-bc7c-a0276358bb45" released by "delete_volume" :: held 0.915s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created reservations ['27b3f2fa-db54-4722-8a13-5468e024c240', '121f73eb-876d-4501-9bc6-9b7100e9c73a', '6c7af75b-4cb4-4a09-992e-dd0d6d8e2344', 'e654e8d1-bef5-4268-a528-3a71381bbdda'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:53 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:53 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-quobyte-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:53 devstack sudo[89919]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] 35717e41-b49c-4e85-9a50-2d2207b8655c was qcow2, converting to raw {{(pid=82546) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b975b5-510f-4e52-af28-85535ed72f01]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:53 devstack sudo[89927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de Apr 10 12:20:53 devstack sudo[89927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:53 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 Apr 10 12:20:53 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:54 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.433s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:54 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Deleted volume successfully. Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fff3b942-f4de-4797-856e-119e021d1e6d tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-495975c7-71c5-4f83-bc7c-a0276358bb45-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:54 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8" returned: 0 in 0.508s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:54 devstack sudo[89949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8 Apr 10 12:20:54 devstack sudo[89949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:54 devstack sudo[89927]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de" returned: 0 in 0.845s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_35717e41-b49c-4e85-9a50-2d2207b8655c_2j2e3hwkdevstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:20:54 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Converted 112.00 MB image at 112.00 MB/s Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:54 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de 1G Apr 10 12:20:54 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:54 devstack sudo[89949]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8" returned: 0 in 0.458s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8" released by "delete_volume" :: held 1.017s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created reservations ['7333b8ba-665f-41c4-bce5-96b094a0b72d', '11b9cb18-6e47-4a2a-9a0c-4fb6b27bee95', '1bea5b91-d383-456f-b245-11ab212b9743', '8470a69e-1cfb-4538-a9b9-ca38ff6e3b4a'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:54 devstack sudo[89954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:54 devstack sudo[89954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:55 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de 1G" returned: 0 in 0.442s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:55 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[37516917-162f-4711-8163-d40839f1343f]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:55 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de Apr 10 12:20:55 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:55 devstack sudo[89954]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.423s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:55 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Deleted volume successfully. Apr 10 12:20:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-da0e605c-0bef-45c7-b2ae-9996126f6c32 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-8e28e6bf-3442-4b03-9cd5-fda15e40c9c8-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:55 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de" returned: 0 in 0.470s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:55 devstack sudo[89964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de Apr 10 12:20:55 devstack sudo[89964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-136542bb-c550-42aa-9f4b-99e23d4f88b3-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-136542bb-c550-42aa-9f4b-99e23d4f88b3-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-quobyte-136542bb-c550-42aa-9f4b-99e23d4f88b3" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-136542bb-c550-42aa-9f4b-99e23d4f88b3" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[881d931b-11a0-4b3d-be2b-23c4e732a507]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:56 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 Apr 10 12:20:56 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:56 devstack sudo[89964]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de" returned: 1 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Downloaded image 35717e41-b49c-4e85-9a50-2d2207b8655c ((None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}])) to volume cd93385d-52ea-4af2-872c-fba9453738de successfully. {{(pid=82546) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Temporary image 35717e41-b49c-4e85-9a50-2d2207b8655c for user a6d07908ea3c4ac39d655925076eca71 is deleted. {{(pid=82546) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.volume.volume_utils [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Marking volume cd93385d-52ea-4af2-872c-fba9453738de as bootable. {{(pid=82546) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Copying metadata from image 35717e41-b49c-4e85-9a50-2d2207b8655c to cd93385d-52ea-4af2-872c-fba9453738de. {{(pid=82546) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Creating volume glance metadata for volume cd93385d-52ea-4af2-872c-fba9453738de backed by image 35717e41-b49c-4e85-9a50-2d2207b8655c with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82546) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097ed209-b122-4b6a-b6c5-2364fade005d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd93385d-52ea-4af2-872c-fba9453738de', 'volume_size': 1, 'image_id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/35717e41-b49c-4e85-9a50-2d2207b8655c', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '79f8c1bbe1d54cd2bdc41944d9da4403', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '35717e41-b49c-4e85-9a50-2d2207b8655c', 'created_at': datetime.datetime(2026, 4, 10, 10, 9, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 10, 10, 9, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/35717e41-b49c-4e85-9a50-2d2207b8655c/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bfb1d0-9ea2-4999-8c68-028d90f2c2ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:56 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Volume volume-cd93385d-52ea-4af2-872c-fba9453738de (cd93385d-52ea-4af2-872c-fba9453738de): created successfully Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11bfb1d0-9ea2-4999-8c68-028d90f2c2ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (c324f985-6ed4-441c-a974-72158a1ae1a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a4150807-a2ab-42e8-916f-143b2c5a805f tempest-VolumesGetTest-404837712 None] Created volume successfully. Apr 10 12:20:56 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3" returned: 0 in 0.482s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:56 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3 Apr 10 12:20:56 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:56 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-136542bb-c550-42aa-9f4b-99e23d4f88b3" returned: 0 in 0.442s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-136542bb-c550-42aa-9f4b-99e23d4f88b3" released by "delete_volume" :: held 0.952s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created reservations ['4f8e5701-34f7-4aaf-8894-85bc64345831', 'f0f93c22-7d05-4926-bd5c-8c555872789c', '289be433-46d7-44aa-851e-90f2d52969ac', '57e21b7e-dccb-417e-9132-5ac4ef60609c'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (6fd689f9-6a96-4f60-a7ef-a18f735b8484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7cf8b6-ab37-4a51-bb4b-6683162b69a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b7cf8b6-ab37-4a51-bb4b-6683162b69a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-458492133',display_name='tempest-VolumesGetTest-Volume-1748221083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03a73bd-5c3d-45fc-8cca-dc17c3627ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:57Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e944aefd-4424-44da-942c-7af65afa1b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e944aefd-4424-44da-942c-7af65afa1b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2a8331-907a-4591-a474-0a428fe585f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2a8331-907a-4591-a474-0a428fe585f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03a73bd-5c3d-45fc-8cca-dc17c3627ab3', 'volume_name': 'volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925dddcd-9f75-495e-9235-952918c5e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925dddcd-9f75-495e-9235-952918c5e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed318c8e-3603-4850-ad7c-da61adf12868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:57 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Volume a03a73bd-5c3d-45fc-8cca-dc17c3627ab3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3', 'volume_size': 1} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:20:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-458492133',display_name='tempest-VolumesGetTest-Volume-1748221083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03a73bd-5c3d-45fc-8cca-dc17c3627ab3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3e46feaeacc44de9815de44ec9dfa9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:20:57Z,use_quota=True,user_id='a6d07908ea3c4ac39d655925076eca71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Creating volume a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:20:57 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:57 devstack sudo[89977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 1073741824 Apr 10 12:20:57 devstack sudo[89977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:57 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:57 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:57 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.424s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:57 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Deleted volume successfully. Apr 10 12:20:57 devstack sudo[89977]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-98165128-4369-44da-970f-f2e4e4c6059f tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-136542bb-c550-42aa-9f4b-99e23d4f88b3-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 1073741824" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:57 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 Apr 10 12:20:57 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:58 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3" returned: 0 in 0.402s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed318c8e-3603-4850-ad7c-da61adf12868) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad9e08-e454-44ff-88a2-54bef21b5389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:20:58 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Volume volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 (a03a73bd-5c3d-45fc-8cca-dc17c3627ab3): created successfully Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ad9e08-e454-44ff-88a2-54bef21b5389) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Flow 'volume_create_manager' (6fd689f9-6a96-4f60-a7ef-a18f735b8484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:20:58 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-266b2189-a60e-4894-a452-0861a1f21c6b tempest-VolumesGetTest-404837712 None] Created volume successfully. Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-2af5d2b3-593b-4c81-bacd-549d40290b27-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-2af5d2b3-593b-4c81-bacd-549d40290b27-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-quobyte-2af5d2b3-593b-4c81-bacd-549d40290b27" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-2af5d2b3-593b-4c81-bacd-549d40290b27" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16fd7e0-c7ca-4e24-b4e7-5f553397521a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:58 devstack sudo[89988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 Apr 10 12:20:58 devstack sudo[89988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:58 devstack sudo[89988]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27" returned: 0 in 0.456s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:58 devstack sudo[89993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27 Apr 10 12:20:58 devstack sudo[89993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:59 devstack sudo[89993]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2af5d2b3-593b-4c81-bacd-549d40290b27" returned: 0 in 0.398s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-2af5d2b3-593b-4c81-bacd-549d40290b27" released by "delete_volume" :: held 0.880s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created reservations ['cc40f169-8a2f-4b73-bb29-911ee2d42850', '15673906-a455-4e91-a73f-38df090484e3', 'b93420f9-df79-4a3f-892f-7f62fc4258b8', 'd35966f8-d466-4df1-a527-655d7df75e4b'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:59 devstack sudo[89996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:20:59 devstack sudo[89996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Lock "cinder-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-49e7c61d-db8c-45c9-a197-24af4812a70e-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-49e7c61d-db8c-45c9-a197-24af4812a70e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3" acquired by "delete_volume" :: waited 0.025s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a7c47a-9ee8-4a1e-9e81-4c97b22e1fd3]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-quobyte-49e7c61d-db8c-45c9-a197-24af4812a70e" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-49e7c61d-db8c-45c9-a197-24af4812a70e" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed921cd6-e42e-4766-945c-da04fbf0b912]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:59 devstack sudo[89998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 Apr 10 12:20:59 devstack sudo[89998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:59 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e Apr 10 12:20:59 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:59 devstack sudo[89996]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.442s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:20:59 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Deleted volume successfully. Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-45218bd8-9ab9-454c-8c35-b1385a0c5e88 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-2af5d2b3-593b-4c81-bacd-549d40290b27-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:20:59 devstack sudo[89998]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:59 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:20:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:20:59 devstack sudo[90009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3 Apr 10 12:20:59 devstack sudo[90009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:20:59 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e Apr 10 12:20:59 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:00 devstack sudo[90009]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3" returned: 0 in 0.402s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3" released by "delete_volume" :: held 0.918s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:00 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-49e7c61d-db8c-45c9-a197-24af4812a70e" returned: 0 in 0.406s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-49e7c61d-db8c-45c9-a197-24af4812a70e" released by "delete_volume" :: held 0.908s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Created reservations ['594086b1-c1cc-4689-bf06-ea5342e656c0', 'cec30891-4b07-4a31-bd1b-3e2fd7638f7d', '981e8b42-b2d4-4939-ae29-bd8e1a4410e3', '43b9aa59-244c-41c5-bb22-9f2f73a42989'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created reservations ['44cf4f36-329f-4104-a518-8bc46d8bd09b', '848c42fc-b637-4fbf-8451-e27e3de2d02a', 'f192bcc3-c8ad-4905-bfa3-046d5e2000f0', '0e674128-8b23-49d3-9ded-b933d4278121'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:00 devstack sudo[90015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:00 devstack sudo[90015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:00 devstack sudo[90017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:00 devstack sudo[90017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-cd93385d-52ea-4af2-872c-fba9453738de-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Lock "cinder-cd93385d-52ea-4af2-872c-fba9453738de-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Acquiring lock "cinder-quobyte-cd93385d-52ea-4af2-872c-fba9453738de" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-cd93385d-52ea-4af2-872c-fba9453738de" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[576ca97e-2574-46a5-9605-265b66832c77]: (4, 'raw') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:00 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de Apr 10 12:21:00 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:00 devstack sudo[90015]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.428s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Deleted volume successfully. Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c6228268-1873-477a-9ee0-a0d1fd2e5497 tempest-VolumesGetTest-404837712 None] Lock "cinder-a03a73bd-5c3d-45fc-8cca-dc17c3627ab3-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:00 devstack sudo[90017]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.430s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Deleted volume successfully. Apr 10 12:21:00 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1c823939-db0a-4782-ada2-57cacc81387b tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-49e7c61d-db8c-45c9-a197-24af4812a70e-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:01 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de" returned: 0 in 0.486s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:01 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de Apr 10 12:21:01 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-165ffcab-16c4-479c-b14c-e6522f175293-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-165ffcab-16c4-479c-b14c-e6522f175293-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-quobyte-c07c49e8-d6cb-4484-ba76-0d48febe7060" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-c07c49e8-d6cb-4484-ba76-0d48febe7060" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-quobyte-165ffcab-16c4-479c-b14c-e6522f175293" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-165ffcab-16c4-479c-b14c-e6522f175293" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Deleting offline snapshot 165ffcab-16c4-479c-b14c-e6522f175293 of volume c07c49e8-d6cb-4484-ba76-0d48febe7060 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:21:01 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] snapshot_file for this snap is: volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de" returned: 1 in 0.494s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de' failed. Not Retrying. {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14870d8-ce29-4a07-bc03-b5f833ffb056]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:01 devstack sudo[90030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de Apr 10 12:21:01 devstack sudo[90030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:01 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 Apr 10 12:21:01 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:01 devstack sudo[90030]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd93385d-52ea-4af2-872c-fba9453738de" returned: 0 in 0.400s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:01 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Lock "cinder-quobyte-cd93385d-52ea-4af2-872c-fba9453738de" released by "delete_volume" :: held 1.428s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Created reservations ['b2c7b15f-b2e1-43f5-b118-4a4807c0573e', '72b94a2d-bb71-4f32-ab1d-ce0aab01c291', '6dbe82dc-19c7-48d6-a3bf-9502d1fcb9a2', '934e8437-be76-4ee0-a13d-9dd535cdeb24'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:02 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c07c49e8-d6cb-4484-ba76-0d48febe7060(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfd432b-dd86-4b13-9fee-cfac9a8649fc]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:02 devstack sudo[90039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:02 devstack sudo[90039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:02 devstack sudo[90038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 Apr 10 12:21:02 devstack sudo[90038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:02 devstack sudo[90039]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.414s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:02 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Deleted volume successfully. Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0daa8169-e7af-4aa6-9754-29b4cf5de583 tempest-VolumesGetTest-404837712 None] Lock "cinder-cd93385d-52ea-4af2-872c-fba9453738de-delete_volume" released by "delete_volume" :: held 2.041s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:02 devstack sudo[90038]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:02 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 Apr 10 12:21:02 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:02 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293" returned: 0 in 0.465s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:03 devstack sudo[90051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293 Apr 10 12:21:03 devstack sudo[90051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:03 devstack sudo[90051]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060.165ffcab-16c4-479c-b14c-e6522f175293" returned: 0 in 0.499s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:03 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-165ffcab-16c4-479c-b14c-e6522f175293" released by "_delete_snapshot" :: held 2.008s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:03 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-c07c49e8-d6cb-4484-ba76-0d48febe7060" released by "delete_snapshot" :: held 2.021s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:03 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created reservations ['0857d79b-f32f-4ce4-bcee-bd8a142545b9', 'cf7026c4-ffd6-40e9-ad1d-1bbdda9d76e1', '33c20595-3746-4e85-94f2-5b12582f6a9a', '6826ab3c-71b8-48c6-a43b-99f047a27a47'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:03 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Delete snapshot completed successfully. Apr 10 12:21:03 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bd2de565-6a93-4888-8a8e-60863a7aa3ab tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-165ffcab-16c4-479c-b14c-e6522f175293-delete_snapshot" released by "delete_snapshot" :: held 2.112s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-c07c49e8-d6cb-4484-ba76-0d48febe7060-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-c07c49e8-d6cb-4484-ba76-0d48febe7060-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "cinder-quobyte-c07c49e8-d6cb-4484-ba76-0d48febe7060" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-c07c49e8-d6cb-4484-ba76-0d48febe7060" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:04 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8b096a-3edc-45f7-954f-456f3887b519]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:04 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 Apr 10 12:21:04 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:05 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060" returned: 0 in 0.518s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:05 devstack sudo[90061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060 Apr 10 12:21:05 devstack sudo[90061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:05 devstack sudo[90061]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c07c49e8-d6cb-4484-ba76-0d48febe7060" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-quobyte-c07c49e8-d6cb-4484-ba76-0d48febe7060" released by "delete_volume" :: held 1.011s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (64dc9ec9-2220-47ae-a8d7-53ca109af5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a30edb2-df74-4f09-90a2-c8fa69fd1b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a30edb2-df74-4f09-90a2-c8fa69fd1b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2103570552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd950e01-6c0f-4691-8cf5-8c27a2b1fff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7400b69f-641e-45da-9fe7-ef71f445c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7400b69f-641e-45da-9fe7-ef71f445c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b962f9-f4c5-4881-903a-3d31ea97afcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b962f9-f4c5-4881-903a-3d31ea97afcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd950e01-6c0f-4691-8cf5-8c27a2b1fff2', 'volume_name': 'volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041b0b04-20f3-4041-9b13-1798771b7e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (041b0b04-20f3-4041-9b13-1798771b7e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3860d701-7754-48db-b940-5fca421f8e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Volume cd950e01-6c0f-4691-8cf5-8c27a2b1fff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2', 'volume_size': 1} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2103570552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd950e01-6c0f-4691-8cf5-8c27a2b1fff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Creating volume cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:05 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:05 devstack sudo[90064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 1073741824 Apr 10 12:21:05 devstack sudo[90064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Created reservations ['587ac005-c787-4023-9836-b21862f3a1e2', 'f07f4cc0-c11a-4aab-a652-c356625738db', 'd2b557e1-4642-4e41-af69-2495daf2ad84', '0aa491d7-4035-4160-b843-c9e00b153db6'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (566d97e4-8039-4cbf-ae93-3a794982a498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1270f1-16ed-4807-be80-04636ddaeb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f1270f1-16ed-4807-be80-04636ddaeb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114722093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14014f96-a92f-4aad-8910-6554de9cb9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aea8165-4a1f-4af1-9665-fd214ad69a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aea8165-4a1f-4af1-9665-fd214ad69a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d927ac-4c86-47ba-af14-c5f2223b50cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55d927ac-4c86-47ba-af14-c5f2223b50cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14014f96-a92f-4aad-8910-6554de9cb9d3', 'volume_name': 'volume-14014f96-a92f-4aad-8910-6554de9cb9d3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3361f2-620a-422a-bb8e-494c0e9f9699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3361f2-620a-422a-bb8e-494c0e9f9699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982b1449-eacb-4cbe-ba56-063602d43011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:05 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Volume 14014f96-a92f-4aad-8910-6554de9cb9d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14014f96-a92f-4aad-8910-6554de9cb9d3', 'volume_size': 1} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:05 devstack sudo[90066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:05 devstack sudo[90066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (df07f0f3-970a-414a-8c1d-bd0b82de3321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db237b0-4013-40e0-9951-a86eed7876de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6db237b0-4013-40e0-9951-a86eed7876de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-558172332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6cfeb8-8aba-4749-9d5e-101e7e713321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fab4d9-45e4-499c-8f3b-4315e7748fb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2fab4d9-45e4-499c-8f3b-4315e7748fb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19913261-3855-4382-8f49-2ee071608eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19913261-3855-4382-8f49-2ee071608eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6cfeb8-8aba-4749-9d5e-101e7e713321', 'volume_name': 'volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9467e5a2-9ce7-4826-951f-78deb243ebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9467e5a2-9ce7-4826-951f-78deb243ebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e224bca-7842-40b2-848b-a5ce004cd259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Volume 4a6cfeb8-8aba-4749-9d5e-101e7e713321: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321', 'volume_size': 1} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:06 devstack sudo[90064]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (b66e7aac-4c32-4a97-b876-666698f9602d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55117fd-6034-4ad0-a98f-772a4ed5a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d55117fd-6034-4ad0-a98f-772a4ed5a407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582769382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6266d8a1-a66a-4f95-a669-30d269ecfbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6266d8a1-a66a-4f95-a669-30d269ecfbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf4cf0f-2c54-4db7-a1a0-8818868c673b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcf4cf0f-2c54-4db7-a1a0-8818868c673b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a', 'volume_name': 'volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d862d3a-5379-4a21-a61f-d65b9f318081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d862d3a-5379-4a21-a61f-d65b9f318081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844c7d06-3c97-4dd2-a77f-a696d12d8ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Volume c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a', 'volume_size': 1} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 1073741824" returned: 0 in 0.587s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:06 devstack sudo[90072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 Apr 10 12:21:06 devstack sudo[90072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:06 devstack sudo[90066]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.504s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:06 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Deleted volume successfully. Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6c884f99-4c3b-47ff-a9fc-eadfe2288cf6 tempest-CreateVolumesFromSnapshotTest-1897688698 None] Lock "cinder-c07c49e8-d6cb-4484-ba76-0d48febe7060-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (0b2ccfd8-8e65-4d3b-8125-b010fc33048d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e648c1-3043-4987-b456-1adbf60df4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e648c1-3043-4987-b456-1adbf60df4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108782946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed42981-8140-4ad5-bf5b-f54715d39fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46d3b6d-9c64-443d-99ab-53175804b232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f46d3b6d-9c64-443d-99ab-53175804b232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bef4d31-98a7-48ee-83c2-4145989dca62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bef4d31-98a7-48ee-83c2-4145989dca62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ed42981-8140-4ad5-bf5b-f54715d39fe7', 'volume_name': 'volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0fea73-cbfe-4ab2-af00-4fb6b0ab74df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0fea73-cbfe-4ab2-af00-4fb6b0ab74df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18744598-c484-4825-a3d5-a9182fa749c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Volume 7ed42981-8140-4ad5-bf5b-f54715d39fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7', 'volume_size': 1} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:06 devstack sudo[90072]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2" returned: 0 in 0.445s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.869s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2114722093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14014f96-a92f-4aad-8910-6554de9cb9d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Creating volume 14014f96-a92f-4aad-8910-6554de9cb9d3 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:06 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3860d701-7754-48db-b940-5fca421f8e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391d6cbc-9e16-40b7-9dde-c7cf6c6dd151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:06 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 1073741824 Apr 10 12:21:06 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:06 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Volume volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 (cd950e01-6c0f-4691-8cf5-8c27a2b1fff2): created successfully Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (391d6cbc-9e16-40b7-9dde-c7cf6c6dd151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:06 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (64dc9ec9-2220-47ae-a8d7-53ca109af5f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:06 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e90f33b3-1612-4821-bf09-cdce8f27fbd6 tempest-CreateVolumesFromImageTest-1048566743 None] Created volume successfully. Apr 10 12:21:07 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 1073741824" returned: 0 in 0.532s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:07 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 Apr 10 12:21:07 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:07 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3" returned: 0 in 0.438s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.651s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-558172332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6cfeb8-8aba-4749-9d5e-101e7e713321,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Creating volume 4a6cfeb8-8aba-4749-9d5e-101e7e713321 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:07 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (982b1449-eacb-4cbe-ba56-063602d43011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14014f96-a92f-4aad-8910-6554de9cb9d3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:07 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 1073741824 Apr 10 12:21:07 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7962974b-aed9-4754-b119-7906e7d945d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:07 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Volume volume-14014f96-a92f-4aad-8910-6554de9cb9d3 (14014f96-a92f-4aad-8910-6554de9cb9d3): created successfully Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7962974b-aed9-4754-b119-7906e7d945d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:07 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (566d97e4-8039-4cbf-ae93-3a794982a498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:07 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-502a3de7-0373-4148-be8c-8fdfd485abd2 tempest-CreateVolumesFromImageTest-1048566743 None] Created volume successfully. Apr 10 12:21:08 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 1073741824" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:08 devstack sudo[90088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 Apr 10 12:21:08 devstack sudo[90088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:08 devstack sudo[90088]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321" returned: 0 in 0.407s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.405s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582769382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Creating volume c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:08 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e224bca-7842-40b2-848b-a5ce004cd259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:08 devstack sudo[90091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a 1073741824 Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c19170c-d0fd-4526-acd4-2e18650a76d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:08 devstack sudo[90091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:08 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Volume volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 (4a6cfeb8-8aba-4749-9d5e-101e7e713321): created successfully Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c19170c-d0fd-4526-acd4-2e18650a76d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (df07f0f3-970a-414a-8c1d-bd0b82de3321) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:08 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-72dcd23a-d3c3-46a1-8b7e-918f02783a0d tempest-CreateVolumesFromImageTest-1048566743 None] Created volume successfully. Apr 10 12:21:09 devstack sudo[90091]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a 1073741824" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:09 devstack sudo[90096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a Apr 10 12:21:09 devstack sudo[90096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:09 devstack sudo[90096]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a" returned: 0 in 0.407s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.113s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-108782946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ed42981-8140-4ad5-bf5b-f54715d39fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7553e46e88af407fbb0d94545e1e69b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:06Z,use_quota=True,user_id='f8b9b6406da3415fbc5198f4ff471957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Creating volume 7ed42981-8140-4ad5-bf5b-f54715d39fe7 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:09 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:09 devstack sudo[90099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 1073741824 Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (844c7d06-3c97-4dd2-a77f-a696d12d8ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eef332-7703-4963-a730-de72c0bce742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:09 devstack sudo[90099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:09 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Volume volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a (c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a): created successfully Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61eef332-7703-4963-a730-de72c0bce742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:09 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (b66e7aac-4c32-4a97-b876-666698f9602d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:09 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-163d9198-a277-4989-a1c6-93a276c4a7f1 tempest-CreateVolumesFromImageTest-1048566743 None] Created volume successfully. Apr 10 12:21:10 devstack sudo[90099]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 1073741824" returned: 0 in 0.483s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:10 devstack sudo[90104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 Apr 10 12:21:10 devstack sudo[90104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:10 devstack sudo[90104]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7" returned: 0 in 0.407s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18744598-c484-4825-a3d5-a9182fa749c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55fb16d-8c38-4dcb-9d71-728ad88b7290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:10 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Volume volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 (7ed42981-8140-4ad5-bf5b-f54715d39fe7): created successfully Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f55fb16d-8c38-4dcb-9d71-728ad88b7290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Flow 'volume_create_manager' (0b2ccfd8-8e65-4d3b-8125-b010fc33048d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:10 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-827e7d0f-e34b-46a7-a948-63591729f4ad tempest-CreateVolumesFromImageTest-1048566743 None] Created volume successfully. Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-7ed42981-8140-4ad5-bf5b-f54715d39fe7-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-7ed42981-8140-4ad5-bf5b-f54715d39fe7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-quobyte-7ed42981-8140-4ad5-bf5b-f54715d39fe7" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-7ed42981-8140-4ad5-bf5b-f54715d39fe7" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdabe7a-ee93-4d16-acfd-145ce2f77c42]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:11 devstack sudo[90107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 Apr 10 12:21:11 devstack sudo[90107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:11 devstack sudo[90107]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7" returned: 0 in 0.453s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:11 devstack sudo[90112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7 Apr 10 12:21:11 devstack sudo[90112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:11 devstack sudo[90112]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-7ed42981-8140-4ad5-bf5b-f54715d39fe7" returned: 0 in 0.417s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-7ed42981-8140-4ad5-bf5b-f54715d39fe7" released by "delete_volume" :: held 0.890s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Created reservations ['a1243c98-4921-45e2-9941-b809007697fc', '679bf811-040a-4dd1-a743-129a55bc16da', '4b31ec95-ef4b-42ef-b598-dc3264a63a14', 'f35ff5f9-27f7-47c3-87c5-897736e3559d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:11 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:11 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-quobyte-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ded9fdf-f6ab-4f5a-8e70-8bfb6a659c4f]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:12 devstack sudo[90117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a Apr 10 12:21:12 devstack sudo[90117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:12 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.424s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:12 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Deleted volume successfully. Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-134bcc0d-4652-4431-851c-edc5d665fae3 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-7ed42981-8140-4ad5-bf5b-f54715d39fe7-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:12 devstack sudo[90117]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a" returned: 0 in 0.467s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:12 devstack sudo[90123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a Apr 10 12:21:12 devstack sudo[90123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:12 devstack sudo[90123]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a" returned: 0 in 0.418s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a" released by "delete_volume" :: held 0.914s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:12 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Created reservations ['0aac31f3-5a72-4570-9f1e-ab7d54d2bac9', '02544764-f5fa-475d-b366-a6e41ef1d7b9', 'd4e97022-dd00-4eea-9459-1df9bc369cb7', '6e649af1-7647-45fc-a205-fc7dadfd8eb5'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:13 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:13 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-4a6cfeb8-8aba-4749-9d5e-101e7e713321-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-4a6cfeb8-8aba-4749-9d5e-101e7e713321-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-quobyte-4a6cfeb8-8aba-4749-9d5e-101e7e713321" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-4a6cfeb8-8aba-4749-9d5e-101e7e713321" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[330f8938-9aac-4de1-af5c-2e0ce0931ff9]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:13 devstack sudo[90128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 Apr 10 12:21:13 devstack sudo[90128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:13 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.421s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:13 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Deleted volume successfully. Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-2c584318-9f3d-4592-8370-ae1deedcb289 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-c2af6a6d-e5e3-439d-bec5-38fb84cb7e9a-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:13 devstack sudo[90128]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321" returned: 0 in 0.471s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:13 devstack sudo[90134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321 Apr 10 12:21:13 devstack sudo[90134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:14 devstack sudo[90134]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4a6cfeb8-8aba-4749-9d5e-101e7e713321" returned: 0 in 0.409s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-4a6cfeb8-8aba-4749-9d5e-101e7e713321" released by "delete_volume" :: held 0.917s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:14 devstack sudo[90138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:14 devstack sudo[90138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Created reservations ['5188cced-2c96-45d6-92b7-da7b84dfb00b', '4de1b9cc-1cdf-42fd-8a43-36b256eba93b', '6ac00325-4dcf-49af-b8b9-32282acb8ec0', '13704c2f-f158-467d-89e7-bcaa83d0f9e4'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:14 devstack sudo[90140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:14 devstack sudo[90140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-14014f96-a92f-4aad-8910-6554de9cb9d3-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-14014f96-a92f-4aad-8910-6554de9cb9d3-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-quobyte-14014f96-a92f-4aad-8910-6554de9cb9d3" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-14014f96-a92f-4aad-8910-6554de9cb9d3" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[a66b8fe1-6507-448d-bed1-01572f911cf7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:14 devstack sudo[90142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 Apr 10 12:21:14 devstack sudo[90142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:14 devstack sudo[90138]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.448s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:14 devstack sudo[90140]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.444s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:14 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Deleted volume successfully. Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-46852dd6-e1fb-4aaa-98c2-f78149b917bc tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-4a6cfeb8-8aba-4749-9d5e-101e7e713321-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:14 devstack sudo[90142]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3" returned: 0 in 0.486s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:14 devstack sudo[90149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3 Apr 10 12:21:14 devstack sudo[90149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:15 devstack sudo[90149]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-14014f96-a92f-4aad-8910-6554de9cb9d3" returned: 0 in 0.412s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-14014f96-a92f-4aad-8910-6554de9cb9d3" released by "delete_volume" :: held 0.921s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Created reservations ['d27eabb6-b7fa-4d58-8cb6-9358f58d2584', '3279c004-5080-4bda-99b0-3d1a0e7740c7', 'ecd8f0d7-eada-4e31-8db8-ac199a33a890', 'fd99860a-acd6-410d-ba00-08b7edeee982'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:15 devstack sudo[90152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:15 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "cinder-quobyte-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c5fc5c-e515-40f5-84c3-81872e813a6d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:15 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 Apr 10 12:21:15 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:15 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.425s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:15 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Deleted volume successfully. Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-884eda0d-d0bf-4080-94c0-27d1de8bb500 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-14014f96-a92f-4aad-8910-6554de9cb9d3-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:15 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2" returned: 0 in 0.461s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:15 devstack sudo[90160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2 Apr 10 12:21:15 devstack sudo[90160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:16 devstack sudo[90160]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2" returned: 0 in 0.418s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-quobyte-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2" released by "delete_volume" :: held 0.902s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Created reservations ['b2e10ac8-cad3-4a6c-bfd6-0a8b2711103d', '2315d2cb-d306-468c-90be-2aecfcd3a288', '0b3b512b-5c66-4212-8ce2-5b77dfcfb4af', '6a6f1135-9ab1-40f2-8268-4d176c0b8720'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:16 devstack sudo[90163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:16 devstack sudo[90163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:16 devstack sudo[90163]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.413s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:16 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Deleted volume successfully. Apr 10 12:21:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-22af58b9-9099-416e-bc2d-450899dd9c59 tempest-CreateVolumesFromImageTest-1048566743 None] Lock "cinder-cd950e01-6c0f-4691-8cf5-8c27a2b1fff2-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:26 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=119,cinder:INSERT=58,cinder:UPDATE=170,cinder:DELETE=12 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:21:26 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:UPDATE=193,cinder:SELECT=130,cinder:DELETE=20,cinder:INSERT=39 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Flow 'volume_create_manager' (24f89352-7b15-4324-843a-8b3617967f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be69d6d-5508-48c9-8c48-24c7748225dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5be69d6d-5508-48c9-8c48-24c7748225dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-631133595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b86b4b8-9864-468e-9d63-6ebca089b183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed9800ddf7541a7a9a08ab596fa3e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:30Z,use_quota=True,user_id='3608d10f7c7449699acbc1b8b29c7cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5983bf88-3845-4dd7-9ae8-ac6d1b5942d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5983bf88-3845-4dd7-9ae8-ac6d1b5942d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db88382-db47-4de4-8b26-78b27d6bd8bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0db88382-db47-4de4-8b26-78b27d6bd8bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b86b4b8-9864-468e-9d63-6ebca089b183', 'volume_name': 'volume-8b86b4b8-9864-468e-9d63-6ebca089b183', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bacf28f-e807-4b8f-a484-73baaccf1030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bacf28f-e807-4b8f-a484-73baaccf1030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713cd83f-dff6-4f4e-b5b3-0b626a763c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:30 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Volume 8b86b4b8-9864-468e-9d63-6ebca089b183: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b86b4b8-9864-468e-9d63-6ebca089b183', 'volume_size': 1} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-631133595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b86b4b8-9864-468e-9d63-6ebca089b183,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed9800ddf7541a7a9a08ab596fa3e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:30Z,use_quota=True,user_id='3608d10f7c7449699acbc1b8b29c7cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Creating volume 8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:30 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:30 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 1073741824 Apr 10 12:21:30 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:30 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 1073741824" returned: 0 in 0.491s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:30 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 Apr 10 12:21:30 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:31 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183" returned: 0 in 0.409s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:31 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (713cd83f-dff6-4f4e-b5b3-0b626a763c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b86b4b8-9864-468e-9d63-6ebca089b183', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb16828-6d2d-4ba8-ac9d-88b5c190d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:31 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Volume volume-8b86b4b8-9864-468e-9d63-6ebca089b183 (8b86b4b8-9864-468e-9d63-6ebca089b183): created successfully Apr 10 12:21:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1eb16828-6d2d-4ba8-ac9d-88b5c190d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Flow 'volume_create_manager' (24f89352-7b15-4324-843a-8b3617967f63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1db0e2c2-a15e-4bc8-a074-ded2cce758f9 tempest-SnapshotDependencyTests-889831954 None] Created volume successfully. Apr 10 12:21:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Creating offline snapshot 61c00625-ee31-46f8-ac46-22866b6afc1d of volume 8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:21:32 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a6b828-c283-4943-80a4-335756eeeabb]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:32 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 Apr 10 12:21:32 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:32 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183" returned: 0 in 0.455s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:32 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d 1G Apr 10 12:21:32 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:33 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d 1G" returned: 0 in 0.462s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b86b4b8-9864-468e-9d63-6ebca089b183 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:33 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b86b4b8-9864-468e-9d63-6ebca089b183 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d Apr 10 12:21:33 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:33 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b86b4b8-9864-468e-9d63-6ebca089b183 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d" returned: 0 in 0.426s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:33 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d is being set with open permissions: ugo+rw Apr 10 12:21:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:33 devstack sudo[90193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d Apr 10 12:21:33 devstack sudo[90193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:34 devstack sudo[90193]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d" returned: 0 in 0.409s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:34 devstack sudo[90197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.info Apr 10 12:21:34 devstack sudo[90197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:34 devstack sudo[90197]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.info" returned: 0 in 0.425s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:34 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.info is being set with open permissions: ugo+rw Apr 10 12:21:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:34 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.info Apr 10 12:21:34 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:34 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.info" returned: 0 in 0.416s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:35 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-24b9fe0c-3398-4cb1-b544-a195c9303c51 tempest-SnapshotDependencyTests-889831954 None] Create snapshot completed successfully Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Flow 'volume_create_manager' (be948372-433a-41f9-a484-7c6f3c36197c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ea1bce-8413-47b7-bd60-e96f604acac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8ea1bce-8413-47b7-bd60-e96f604acac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:36Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e6446a-4ece-4c69-8f51-6b9007fcc842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ed9800ddf7541a7a9a08ab596fa3e1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61c00625-ee31-46f8-ac46-22866b6afc1d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:36Z,use_quota=True,user_id='3608d10f7c7449699acbc1b8b29c7cfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd4de4f-f889-40ae-b651-9813b035e98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cd4de4f-f889-40ae-b651-9813b035e98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa308d30-a29d-4434-a379-7b50128dd8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa308d30-a29d-4434-a379-7b50128dd8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c4e6446a-4ece-4c69-8f51-6b9007fcc842', 'volume_name': 'volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842', 'volume_size': 1, 'snapshot_id': '61c00625-ee31-46f8-ac46-22866b6afc1d'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99c5eb4-a61c-4ddd-8d46-044d85eb03ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a99c5eb4-a61c-4ddd-8d46-044d85eb03ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47192686-f8db-49a2-944a-3cc2e3468b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:35 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Volume c4e6446a-4ece-4c69-8f51-6b9007fcc842: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842', 'volume_size': 1, 'snapshot_id': '61c00625-ee31-46f8-ac46-22866b6afc1d'} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-quobyte-61c00625-ee31-46f8-ac46-22866b6afc1d-c4e6446a-4ece-4c69-8f51-6b9007fcc842" by "_create_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-61c00625-ee31-46f8-ac46-22866b6afc1d-c4e6446a-4ece-4c69-8f51-6b9007fcc842" acquired by "_create_volume_from_snapshot" :: waited 0.005s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Creating volume c4e6446a-4ece-4c69-8f51-6b9007fcc842 from snapshot 61c00625-ee31-46f8-ac46-22866b6afc1d {{(pid=82546) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-quobyte-c4e6446a-4ece-4c69-8f51-6b9007fcc842" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-c4e6446a-4ece-4c69-8f51-6b9007fcc842" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] snapshot: 61c00625-ee31-46f8-ac46-22866b6afc1d, volume: c4e6446a-4ece-4c69-8f51-6b9007fcc842, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24ad9cb-6117-4c27-bccf-fc0805dd5405]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:35 devstack sudo[90203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d Apr 10 12:21:35 devstack sudo[90203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:36 devstack sudo[90203]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d" returned: 0 in 0.474s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b86b4b8-9864-468e-9d63-6ebca089b183(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbefc039-d757-430f-9f36-a6444c62fed5]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:36 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 Apr 10 12:21:36 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:36 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183" returned: 0 in 0.475s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:21:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:36 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 Apr 10 12:21:36 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:38 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842" returned: 0 in 1.923s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:38 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[66845c43-dbf3-43a4-87d1-b9fad016b2d4]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:38 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 Apr 10 12:21:38 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:39 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183" returned: 0 in 0.636s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183, size 1024.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:21:39 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Converted 1024.00 MB image at 532.15 MB/s Apr 10 12:21:39 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 is being set with open permissions: ugo+rw Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:39 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 Apr 10 12:21:39 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:39 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842" returned: 0 in 0.426s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-c4e6446a-4ece-4c69-8f51-6b9007fcc842" released by "_copy_volume_from_snapshot" :: held 3.987s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-61c00625-ee31-46f8-ac46-22866b6afc1d-c4e6446a-4ece-4c69-8f51-6b9007fcc842" released by "_create_volume_from_snapshot" :: held 4.001s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47192686-f8db-49a2-944a-3cc2e3468b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842', 'volume_size': 1, 'snapshot_id': '61c00625-ee31-46f8-ac46-22866b6afc1d'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677d78c5-c892-460a-b277-7f787907afec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:39 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Volume volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 (c4e6446a-4ece-4c69-8f51-6b9007fcc842): created successfully Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (677d78c5-c892-460a-b277-7f787907afec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Flow 'volume_create_manager' (be948372-433a-41f9-a484-7c6f3c36197c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:39 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-eb1a6b37-38b6-465b-a442-b4e642f06f90 tempest-SnapshotDependencyTests-889831954 None] Created volume successfully. Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-61c00625-ee31-46f8-ac46-22866b6afc1d-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-61c00625-ee31-46f8-ac46-22866b6afc1d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-quobyte-8b86b4b8-9864-468e-9d63-6ebca089b183" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-8b86b4b8-9864-468e-9d63-6ebca089b183" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-quobyte-61c00625-ee31-46f8-ac46-22866b6afc1d" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-61c00625-ee31-46f8-ac46-22866b6afc1d" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Deleting offline snapshot 61c00625-ee31-46f8-ac46-22866b6afc1d of volume 8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] snapshot_file for this snap is: volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f8085e-e256-464a-8d48-c95bf9bf6a24]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:40 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d Apr 10 12:21:40 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:40 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d" returned: 0 in 0.463s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b86b4b8-9864-468e-9d63-6ebca089b183(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[36e1a5c9-4635-4584-9558-b68cd3d730ca]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:40 devstack sudo[90239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 Apr 10 12:21:40 devstack sudo[90239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:41 devstack sudo[90239]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183" returned: 0 in 0.459s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:41 devstack sudo[90244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d Apr 10 12:21:41 devstack sudo[90244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:41 devstack sudo[90244]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d" returned: 0 in 0.446s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:41 devstack sudo[90249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d Apr 10 12:21:41 devstack sudo[90249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:41 devstack sudo[90249]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183.61c00625-ee31-46f8-ac46-22866b6afc1d" returned: 0 in 0.397s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-61c00625-ee31-46f8-ac46-22866b6afc1d" released by "_delete_snapshot" :: held 1.819s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-8b86b4b8-9864-468e-9d63-6ebca089b183" released by "delete_snapshot" :: held 1.832s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Created reservations ['31cd488b-faac-4532-aaeb-35357e795914', '60b6b036-00b2-4882-8f22-b4c609a3eef1', 'c291776a-eeeb-422c-ba0c-56c3991fa5f6', '81525fcd-2c28-474a-bd1b-ced0c0c8f055'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Delete snapshot completed successfully. Apr 10 12:21:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-e90fc322-9b34-43f4-8bb6-a2b60bb36419 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-61c00625-ee31-46f8-ac46-22866b6afc1d-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-8b86b4b8-9864-468e-9d63-6ebca089b183-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-8b86b4b8-9864-468e-9d63-6ebca089b183-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-quobyte-8b86b4b8-9864-468e-9d63-6ebca089b183" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-8b86b4b8-9864-468e-9d63-6ebca089b183" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:42 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd2b51b-37c6-42a8-b95d-6c140c1280a2]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:42 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 Apr 10 12:21:42 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:42 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183" returned: 0 in 0.469s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:42 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183 Apr 10 12:21:42 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:43 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8b86b4b8-9864-468e-9d63-6ebca089b183" returned: 0 in 0.403s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-8b86b4b8-9864-468e-9d63-6ebca089b183" released by "delete_volume" :: held 0.901s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Created reservations ['349fcf8b-429d-410c-8148-ef3c081ac95f', '44dbe055-9e3d-4589-84db-98d7a685ea3e', '7dc9ec32-a92c-47ef-8dc6-978331ee05c1', 'cbeb42c0-b105-4c32-b7d5-be8b10825046'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:43 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:43 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-c4e6446a-4ece-4c69-8f51-6b9007fcc842-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-c4e6446a-4ece-4c69-8f51-6b9007fcc842-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "cinder-quobyte-c4e6446a-4ece-4c69-8f51-6b9007fcc842" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-c4e6446a-4ece-4c69-8f51-6b9007fcc842" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28c36ad-444b-4aef-8c06-6086264a4863]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:43 devstack sudo[90262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 Apr 10 12:21:43 devstack sudo[90262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:43 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.423s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:43 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Deleted volume successfully. Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-be170da2-fb95-4c11-8858-81f2b6b7d80c tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-8b86b4b8-9864-468e-9d63-6ebca089b183-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:43 devstack sudo[90262]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842" returned: 0 in 0.462s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:43 devstack sudo[90274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842 Apr 10 12:21:43 devstack sudo[90274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:44 devstack sudo[90274]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c4e6446a-4ece-4c69-8f51-6b9007fcc842" returned: 0 in 0.413s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-quobyte-c4e6446a-4ece-4c69-8f51-6b9007fcc842" released by "delete_volume" :: held 0.898s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Created reservations ['039e88d6-4888-4dab-8619-1bd601b32a1b', '477889a2-4d81-4e2b-b5bf-22b4ad59fb50', 'a49daad4-7a1f-4dd0-ba85-edfd7779abd3', '9f2f7221-0bc9-451a-8cd2-b4d86df8cd03'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:44 devstack sudo[90278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:21:44 devstack sudo[90278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:44 devstack sudo[90278]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.463s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:21:44 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Deleted volume successfully. Apr 10 12:21:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-31c5b0c0-9324-4930-a3c9-8dd6f2875923 tempest-SnapshotDependencyTests-889831954 None] Lock "cinder-c4e6446a-4ece-4c69-8f51-6b9007fcc842-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:21:54 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:UPDATE=32,cinder:SELECT=23,cinder:DELETE=3,cinder:INSERT=7 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:21:54 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=2 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Flow 'volume_create_manager' (29689131-54d9-496a-ab47-368ec6bdbc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94747f81-0874-4492-aea1-0523ba3868c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94747f81-0874-4492-aea1-0523ba3868c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1966588269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6702cd-119c-4e6a-b8df-6cc3bd3a2399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9dda212fde440d381c5abd727a14cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:56Z,use_quota=True,user_id='17d2f829bc3d495eac95f364dace4457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f964061-9f8f-4564-b5e9-64ccf6e5aca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f964061-9f8f-4564-b5e9-64ccf6e5aca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930a1065-a8a1-4c31-aae3-5546fd15a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (930a1065-a8a1-4c31-aae3-5546fd15a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf6702cd-119c-4e6a-b8df-6cc3bd3a2399', 'volume_name': 'volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4c9ff1-d4e7-4e47-be55-a798156c7529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4c9ff1-d4e7-4e47-be55-a798156c7529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2e122e-cf56-4eeb-a6fd-6665ba030976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Volume cf6702cd-119c-4e6a-b8df-6cc3bd3a2399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399', 'volume_size': 1} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1966588269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf6702cd-119c-4e6a-b8df-6cc3bd3a2399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9dda212fde440d381c5abd727a14cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:56Z,use_quota=True,user_id='17d2f829bc3d495eac95f364dace4457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Creating volume cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:56 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:56 devstack sudo[90360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 1073741824 Apr 10 12:21:56 devstack sudo[90360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (d7845240-9ae3-4a9c-a31a-b2c8d7a7ffe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751c8cfa-954c-4eff-a753-dd62f490fefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (751c8cfa-954c-4eff-a753-dd62f490fefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-170777923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8172e189-84b5-42c3-a504-2e8de21772f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:56Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b60a74-3ce3-4a0b-a8e0-7a32c3e40a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3b60a74-3ce3-4a0b-a8e0-7a32c3e40a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86a3502-9244-45c0-8aa2-dec4c1c810c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e86a3502-9244-45c0-8aa2-dec4c1c810c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8172e189-84b5-42c3-a504-2e8de21772f2', 'volume_name': 'volume-8172e189-84b5-42c3-a504-2e8de21772f2', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b743c35f-5263-44d7-b72e-92fce08bbf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b743c35f-5263-44d7-b72e-92fce08bbf71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613d7d73-67e2-4c3b-ad07-c3c3e5471a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume 8172e189-84b5-42c3-a504-2e8de21772f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8172e189-84b5-42c3-a504-2e8de21772f2', 'volume_size': 1} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (1a5b7022-cba7-41ac-82fc-1070a36e1d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c49af3-3a68-4a00-8fb4-3a4645e00a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c49af3-3a68-4a00-8fb4-3a4645e00a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412407963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfec920-9ea9-4778-8565-d4afec2effdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9982895-2b5b-4e80-be24-6411610dbea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9982895-2b5b-4e80-be24-6411610dbea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351d2687-77b4-4dbd-a496-6444bd0eeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (351d2687-77b4-4dbd-a496-6444bd0eeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebfec920-9ea9-4778-8565-d4afec2effdf', 'volume_name': 'volume-ebfec920-9ea9-4778-8565-d4afec2effdf', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae05b5b6-19bc-4a0e-9467-971414b63d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae05b5b6-19bc-4a0e-9467-971414b63d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91ebf70-2ea0-4e3e-a83f-3f88e9a67890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Volume ebfec920-9ea9-4778-8565-d4afec2effdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebfec920-9ea9-4778-8565-d4afec2effdf', 'volume_size': 1} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (a3ccd675-c145-49b2-8035-40e6e105ace8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54ddddb-d1c1-42f8-9b78-8873c8b662eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b54ddddb-d1c1-42f8-9b78-8873c8b662eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260924093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7362ee-c450-4d9a-b10a-a1920268e549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb53874f-7144-47b7-ad9a-6f9010914ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb53874f-7144-47b7-ad9a-6f9010914ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34b00c3-b2b9-4ac6-ab99-b4c4de10ad7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e34b00c3-b2b9-4ac6-ab99-b4c4de10ad7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e7362ee-c450-4d9a-b10a-a1920268e549', 'volume_name': 'volume-2e7362ee-c450-4d9a-b10a-a1920268e549', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b09f8e5-78ba-45fd-81cd-9dd14b15d057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b09f8e5-78ba-45fd-81cd-9dd14b15d057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0716344f-b324-460f-8d80-b3540757ccf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume 2e7362ee-c450-4d9a-b10a-a1920268e549: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e7362ee-c450-4d9a-b10a-a1920268e549', 'volume_size': 1} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (434a4497-772f-441b-8f0d-58d0fe0024a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b45a1fd-96f2-4576-bae8-9ef9edcc07c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b45a1fd-96f2-4576-bae8-9ef9edcc07c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207319621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d159662-6c34-4d32-8a5c-b02557de48bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b75047-e1cd-40a1-9795-afb2c59b5412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81b75047-e1cd-40a1-9795-afb2c59b5412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7ba19c-6ec8-4ad0-abd4-2a761c9c7256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7ba19c-6ec8-4ad0-abd4-2a761c9c7256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d159662-6c34-4d32-8a5c-b02557de48bf', 'volume_name': 'volume-8d159662-6c34-4d32-8a5c-b02557de48bf', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5454562c-0708-49ba-8a3f-3f88a392e3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5454562c-0708-49ba-8a3f-3f88a392e3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3ee164-ee3f-43a5-b772-a18cb714fb0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:56 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Volume 8d159662-6c34-4d32-8a5c-b02557de48bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d159662-6c34-4d32-8a5c-b02557de48bf', 'volume_size': 1} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:56 devstack sudo[90360]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:56 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (7915e2a4-9247-4823-bbe5-d9be4b6581ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92541fe7-c3e7-4d07-854d-fd0f3a963e91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92541fe7-c3e7-4d07-854d-fd0f3a963e91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-122167935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db93023d-9ba3-45cf-a031-6c1da5fff176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d96d670-23b9-4241-aef5-04855ac1ea15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d96d670-23b9-4241-aef5-04855ac1ea15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd52f96-b747-44e9-8f1f-f5d80e055202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd52f96-b747-44e9-8f1f-f5d80e055202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db93023d-9ba3-45cf-a031-6c1da5fff176', 'volume_name': 'volume-db93023d-9ba3-45cf-a031-6c1da5fff176', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9f0d6c-e49b-4d9b-8bfe-7f62bad81cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a9f0d6c-e49b-4d9b-8bfe-7f62bad81cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb05702f-9ab8-4ac9-bf7f-b939c4815e0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Volume db93023d-9ba3-45cf-a031-6c1da5fff176: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db93023d-9ba3-45cf-a031-6c1da5fff176', 'volume_size': 1} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 1073741824" returned: 0 in 0.650s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:57 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 Apr 10 12:21:57 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (1ad99c53-e2a3-495f-9155-373812ce1b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0784c4a-02d8-469d-8408-41209e0cf757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0784c4a-02d8-469d-8408-41209e0cf757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1510180820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa78d84c-a4f7-4680-b2dd-9f715400e6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b7d31a-689e-4d1f-aa9a-47dbc7e98038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99b7d31a-689e-4d1f-aa9a-47dbc7e98038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50178962-7e88-4dc1-b554-092203d89b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50178962-7e88-4dc1-b554-092203d89b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa78d84c-a4f7-4680-b2dd-9f715400e6c4', 'volume_name': 'volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b80412-6a6f-4284-8d18-7fef42793741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b80412-6a6f-4284-8d18-7fef42793741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b43ac75-535a-455f-b674-092b4c60a207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Volume fa78d84c-a4f7-4680-b2dd-9f715400e6c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4', 'volume_size': 1} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (80ef12dc-aa55-45de-9bd9-d4e084309bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f74c4c-6a33-4e9d-afca-48b17542c2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3f74c4c-6a33-4e9d-afca-48b17542c2be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2111525675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9ceb8a-bb06-4b28-ac81-785417012373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fdd0d6-a849-4a0e-9b84-e46e712e2701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3fdd0d6-a849-4a0e-9b84-e46e712e2701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6502bfa0-ba1d-4069-9e4b-dd0c5a07b22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6502bfa0-ba1d-4069-9e4b-dd0c5a07b22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9ceb8a-bb06-4b28-ac81-785417012373', 'volume_name': 'volume-db9ceb8a-bb06-4b28-ac81-785417012373', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd08e12c-15c6-4a7f-80ee-49766790d548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd08e12c-15c6-4a7f-80ee-49766790d548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda0d664-14eb-467f-a07a-240c1ba52111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Volume db9ceb8a-bb06-4b28-ac81-785417012373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9ceb8a-bb06-4b28-ac81-785417012373', 'volume_size': 1} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:57 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" returned: 0 in 0.458s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-170777923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8172e189-84b5-42c3-a504-2e8de21772f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:56Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Creating volume 8172e189-84b5-42c3-a504-2e8de21772f2 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:57 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f2e122e-cf56-4eeb-a6fd-6665ba030976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack sudo[90368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 1073741824 Apr 10 12:21:57 devstack sudo[90368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d763b70-53d8-4ea7-974f-fc46663c4ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:57 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Volume volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 (cf6702cd-119c-4e6a-b8df-6cc3bd3a2399): created successfully Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d763b70-53d8-4ea7-974f-fc46663c4ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:57 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Flow 'volume_create_manager' (29689131-54d9-496a-ab47-368ec6bdbc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:57 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f163524c-afa0-4936-a505-ac771e943f89 tempest-VolumeDependencyTests-787239053 None] Created volume successfully. Apr 10 12:21:58 devstack sudo[90368]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 1073741824" returned: 0 in 0.484s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:58 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 Apr 10 12:21:58 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:58 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2" returned: 0 in 0.402s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412407963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebfec920-9ea9-4778-8565-d4afec2effdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Creating volume ebfec920-9ea9-4778-8565-d4afec2effdf {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:58 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (613d7d73-67e2-4c3b-ad07-c3c3e5471a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8172e189-84b5-42c3-a504-2e8de21772f2', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:58 devstack sudo[90376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf 1073741824 Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed58318e-a7ee-4c50-97c8-a061ab7478dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:58 devstack sudo[90376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:58 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume volume-8172e189-84b5-42c3-a504-2e8de21772f2 (8172e189-84b5-42c3-a504-2e8de21772f2): created successfully Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed58318e-a7ee-4c50-97c8-a061ab7478dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (d7845240-9ae3-4a9c-a31a-b2c8d7a7ffe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:58 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0a2710d8-147f-4c65-8aee-7cc4d4d3d5c5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created volume successfully. Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:58 devstack sudo[90376]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf 1073741824" returned: 0 in 0.551s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:59 devstack sudo[90381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf Apr 10 12:21:59 devstack sudo[90381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:59 devstack sudo[90381]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf" returned: 0 in 0.405s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.699s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-260924093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e7362ee-c450-4d9a-b10a-a1920268e549,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Creating volume 2e7362ee-c450-4d9a-b10a-a1920268e549 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:21:59 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f91ebf70-2ea0-4e3e-a83f-3f88e9a67890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebfec920-9ea9-4778-8565-d4afec2effdf', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56a181e-64df-4a06-9ba4-e2d9d8f40433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:21:59 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 1073741824 Apr 10 12:21:59 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:21:59 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Volume volume-ebfec920-9ea9-4778-8565-d4afec2effdf (ebfec920-9ea9-4778-8565-d4afec2effdf): created successfully Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e56a181e-64df-4a06-9ba4-e2d9d8f40433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (1a5b7022-cba7-41ac-82fc-1070a36e1d28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:21:59 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a4f2096a-09da-4643-aaac-3802734a311e tempest-CreateVolumesFromImageTest-877339255 None] Created volume successfully. Apr 10 12:21:59 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 1073741824" returned: 0 in 0.513s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:21:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:21:59 devstack sudo[90389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 Apr 10 12:21:59 devstack sudo[90389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:00 devstack sudo[90389]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549" returned: 0 in 0.397s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] <== create_volume: return (935ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.514s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1207319621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d159662-6c34-4d32-8a5c-b02557de48bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Creating volume 8d159662-6c34-4d32-8a5c-b02557de48bf {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:00 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0716344f-b324-460f-8d80-b3540757ccf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e7362ee-c450-4d9a-b10a-a1920268e549', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c33ed8a-ab05-4dc6-811a-330583e12331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:00 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf 1073741824 Apr 10 12:22:00 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:00 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume volume-2e7362ee-c450-4d9a-b10a-a1920268e549 (2e7362ee-c450-4d9a-b10a-a1920268e549): created successfully Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c33ed8a-ab05-4dc6-811a-330583e12331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (a3ccd675-c145-49b2-8035-40e6e105ace8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:00 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-106b57f1-40fc-4010-815f-0f9915b10649 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created volume successfully. Apr 10 12:22:00 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf 1073741824" returned: 0 in 0.554s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:00 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:00 devstack sudo[90397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf Apr 10 12:22:00 devstack sudo[90397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (46447e98-6379-4bb3-84ec-60911474668e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f331588f-75a5-49d0-8306-31659aebb943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f331588f-75a5-49d0-8306-31659aebb943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-786045840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4364baa7-249b-468b-a56e-19a8b48fa642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:01Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74054438-901a-4c44-a88c-5282e6a53596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74054438-901a-4c44-a88c-5282e6a53596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685ed172-a977-4085-9bd2-762757ff77de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (685ed172-a977-4085-9bd2-762757ff77de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4364baa7-249b-468b-a56e-19a8b48fa642', 'volume_name': 'volume-4364baa7-249b-468b-a56e-19a8b48fa642', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28a7171-fc09-42e2-bba8-8ff8f0e07b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b28a7171-fc09-42e2-bba8-8ff8f0e07b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3dc518-67d4-495f-90b7-9197e320c32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume 4364baa7-249b-468b-a56e-19a8b48fa642: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4364baa7-249b-468b-a56e-19a8b48fa642', 'volume_size': 1} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (29d7d6a7-4d12-47d7-bedd-011b83c87a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1570d841-7efe-41f0-b5fc-a6c19fdf68e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1570d841-7efe-41f0-b5fc-a6c19fdf68e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177392437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040722e5-e2c4-4d37-8498-cbe572fba371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:01Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82849cba-3dd6-431b-b312-45ba028c2396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82849cba-3dd6-431b-b312-45ba028c2396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749f43f0-093b-4546-afe0-39d00b0c6214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749f43f0-093b-4546-afe0-39d00b0c6214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040722e5-e2c4-4d37-8498-cbe572fba371', 'volume_name': 'volume-040722e5-e2c4-4d37-8498-cbe572fba371', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57e444c-1ac0-47ff-b0d4-f53d3a35065a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57e444c-1ac0-47ff-b0d4-f53d3a35065a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8556d21a-dd37-4935-9643-fc92162cc919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume 040722e5-e2c4-4d37-8498-cbe572fba371: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040722e5-e2c4-4d37-8498-cbe572fba371', 'volume_size': 1} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (97cd4923-316c-42d9-a557-6b0e5475414b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1f9fd4-6f56-45df-9f55-ddbf8faa6cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1f9fd4-6f56-45df-9f55-ddbf8faa6cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-986050408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4944bbb8-da89-4b2e-be4e-ba49276fa20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:01Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395bd093-3c30-4fcf-805f-b00b5e6632cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (395bd093-3c30-4fcf-805f-b00b5e6632cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack sudo[90397]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e88c33-58a8-41e2-bbf1-7b4154f28383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13e88c33-58a8-41e2-bbf1-7b4154f28383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4944bbb8-da89-4b2e-be4e-ba49276fa20e', 'volume_name': 'volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca50062c-92af-4c6c-91bb-4d7cd6a5e8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca50062c-92af-4c6c-91bb-4d7cd6a5e8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb23d4b9-ccbc-47d9-9ea3-c674ba181c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume 4944bbb8-da89-4b2e-be4e-ba49276fa20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e', 'volume_size': 1} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.418s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-122167935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db93023d-9ba3-45cf-a031-6c1da5fff176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Creating volume db93023d-9ba3-45cf-a031-6c1da5fff176 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:01 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b3ee164-ee3f-43a5-b772-a18cb714fb0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d159662-6c34-4d32-8a5c-b02557de48bf', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack sudo[90400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 1073741824 Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb601d9-7ddc-4090-9001-3a9a9eaa5517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack sudo[90400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:01 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Volume volume-8d159662-6c34-4d32-8a5c-b02557de48bf (8d159662-6c34-4d32-8a5c-b02557de48bf): created successfully Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb601d9-7ddc-4090-9001-3a9a9eaa5517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (434a4497-772f-441b-8f0d-58d0fe0024a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:01 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-569d49c4-b215-4868-9855-2c397fff54bd tempest-CreateVolumesFromImageTest-877339255 None] Created volume successfully. Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (c94488b8-111a-470c-af99-c1156e0f388d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37729da6-a953-43d3-a4f1-3f9355b18df2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37729da6-a953-43d3-a4f1-3f9355b18df2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217767699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15734eb1-96d4-43de-9bb3-d16eb6c3e466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:02Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93112e2c-4427-44cd-a973-6f9d1fdd4e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93112e2c-4427-44cd-a973-6f9d1fdd4e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67d749e-f7b3-4608-8635-f46f6bd1dbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e67d749e-f7b3-4608-8635-f46f6bd1dbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15734eb1-96d4-43de-9bb3-d16eb6c3e466', 'volume_name': 'volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43054cd9-ad39-42f8-964a-aad98920c930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43054cd9-ad39-42f8-964a-aad98920c930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fd8830-1142-4f12-9667-08bf369a7925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume 15734eb1-96d4-43de-9bb3-d16eb6c3e466: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466', 'volume_size': 1} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (e17d45f2-76ba-4ed8-9697-07779154ffd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87267756-3c45-4805-948e-ab2a9ab96317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87267756-3c45-4805-948e-ab2a9ab96317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008122100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9741f97d-e6ea-45ce-9f1e-8f72853bd793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:02Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ebbb4a-329d-4ecc-8d62-d17d5e9190e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ebbb4a-329d-4ecc-8d62-d17d5e9190e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2d4a79-19ae-45c1-ac42-4a47758e89f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2d4a79-19ae-45c1-ac42-4a47758e89f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9741f97d-e6ea-45ce-9f1e-8f72853bd793', 'volume_name': 'volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f5bf65-77b6-4672-a046-33f51624f0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9f5bf65-77b6-4672-a046-33f51624f0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e9055d-9364-49b7-a793-7f26c3fc141e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:01 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume 9741f97d-e6ea-45ce-9f1e-8f72853bd793: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793', 'volume_size': 1} Apr 10 12:22:01 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:02 devstack sudo[90400]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 1073741824" returned: 0 in 0.556s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:02 devstack sudo[90405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 Apr 10 12:22:02 devstack sudo[90405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:02 devstack sudo[90405]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176" returned: 0 in 0.425s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.224s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1510180820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa78d84c-a4f7-4680-b2dd-9f715400e6c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Creating volume fa78d84c-a4f7-4680-b2dd-9f715400e6c4 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:02 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb05702f-9ab8-4ac9-bf7f-b939c4815e0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db93023d-9ba3-45cf-a031-6c1da5fff176', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:02 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 1073741824 Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e2fdc1-9987-4029-bd5a-01fc924b5f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:02 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:02 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Volume volume-db93023d-9ba3-45cf-a031-6c1da5fff176 (db93023d-9ba3-45cf-a031-6c1da5fff176): created successfully Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7e2fdc1-9987-4029-bd5a-01fc924b5f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:02 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (7915e2a4-9247-4823-bbe5-d9be4b6581ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:02 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d43e46c0-aef7-4de0-b04f-6c356ea84c5e tempest-CreateVolumesFromImageTest-877339255 None] Created volume successfully. Apr 10 12:22:03 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 1073741824" returned: 0 in 0.527s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:03 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 Apr 10 12:22:03 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:03 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4" returned: 0 in 0.425s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.978s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.034s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2111525675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9ceb8a-bb06-4b28-ac81-785417012373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dfd3e5aa7f9f41a289bb909ced6a3fc5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:21:57Z,use_quota=True,user_id='eda82d3bd85840558928d58fb9e7ff94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Creating volume db9ceb8a-bb06-4b28-ac81-785417012373 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:03 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b43ac75-535a-455f-b674-092b4c60a207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:03 devstack sudo[90416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 1073741824 Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd42764-488a-44d2-8c74-77b98fa59fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:03 devstack sudo[90416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:03 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Volume volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 (fa78d84c-a4f7-4680-b2dd-9f715400e6c4): created successfully Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dd42764-488a-44d2-8c74-77b98fa59fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (1ad99c53-e2a3-495f-9155-373812ce1b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:03 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6bb71ee8-0fea-423f-9f5a-e320b9c90ef0 tempest-CreateVolumesFromImageTest-877339255 None] Created volume successfully. Apr 10 12:22:03 devstack sudo[90416]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 1073741824" returned: 0 in 0.507s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:03 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:04 devstack sudo[90421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 Apr 10 12:22:04 devstack sudo[90421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:04 devstack sudo[90421]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373" returned: 0 in 0.411s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.586s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dda0d664-14eb-467f-a07a-240c1ba52111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9ceb8a-bb06-4b28-ac81-785417012373', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1526223-89e2-4f10-bb08-22489a4c5667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Creating offline snapshot c0333b95-7126-4ae2-a55d-2f921708ea1e of volume cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:22:04 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Volume volume-db9ceb8a-bb06-4b28-ac81-785417012373 (db9ceb8a-bb06-4b28-ac81-785417012373): created successfully Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1526223-89e2-4f10-bb08-22489a4c5667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Flow 'volume_create_manager' (80ef12dc-aa55-45de-9bd9-d4e084309bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb64d645-ea74-4425-be4b-27c0ec4d43c7]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:04 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1e0501fe-8397-4bcd-a198-c7ee10a24d6b tempest-CreateVolumesFromImageTest-877339255 None] Created volume successfully. Apr 10 12:22:04 devstack sudo[90425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 Apr 10 12:22:04 devstack sudo[90425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-db9ceb8a-bb06-4b28-ac81-785417012373-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-db9ceb8a-bb06-4b28-ac81-785417012373-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-quobyte-db9ceb8a-bb06-4b28-ac81-785417012373" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:04 devstack sudo[90425]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" returned: 0 in 0.503s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-db9ceb8a-bb06-4b28-ac81-785417012373" acquired by "delete_volume" :: waited 0.024s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:04 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e 1G Apr 10 12:22:04 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba27dc51-7313-48d8-baf4-fb9a7c39d103]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:04 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:05 devstack sudo[90432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 Apr 10 12:22:05 devstack sudo[90432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:05 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e 1G" returned: 0 in 0.473s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:05 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e Apr 10 12:22:05 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:05 devstack sudo[90432]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373" returned: 0 in 0.510s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:05 devstack sudo[90442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373 Apr 10 12:22:05 devstack sudo[90442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:05 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e" returned: 0 in 0.425s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:05 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e is being set with open permissions: ugo+rw Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:05 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e Apr 10 12:22:05 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:05 devstack sudo[90442]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db9ceb8a-bb06-4b28-ac81-785417012373" returned: 0 in 0.407s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-db9ceb8a-bb06-4b28-ac81-785417012373" released by "delete_volume" :: held 0.947s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Created reservations ['91d5832a-5e9e-4894-8093-861b3886e7e3', '901fd41d-c928-4361-974f-c8caeacff642', 'd0dee128-a335-4780-8c77-30ec03b6767b', 'bab9264c-19b2-4855-91be-dd397251038e'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:05 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:06 devstack sudo[90450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:06 devstack sudo[90450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-fa78d84c-a4f7-4680-b2dd-9f715400e6c4-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-fa78d84c-a4f7-4680-b2dd-9f715400e6c4-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-quobyte-fa78d84c-a4f7-4680-b2dd-9f715400e6c4" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-fa78d84c-a4f7-4680-b2dd-9f715400e6c4" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace5137b-29db-402d-b0c1-3719518b20de]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:06 devstack sudo[90452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 Apr 10 12:22:06 devstack sudo[90452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:06 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e" returned: 0 in 0.453s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:06 devstack sudo[90455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.info Apr 10 12:22:06 devstack sudo[90455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:06 devstack sudo[90450]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.455s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:06 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Deleted volume successfully. Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bc80e36e-d7ab-4b92-911f-e33bff1a958c tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-db9ceb8a-bb06-4b28-ac81-785417012373-delete_volume" released by "delete_volume" :: held 1.558s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:06 devstack sudo[90452]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4" returned: 0 in 0.492s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:06 devstack sudo[90461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4 Apr 10 12:22:06 devstack sudo[90461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:06 devstack sudo[90455]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.info" returned: 0 in 0.410s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:06 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.info is being set with open permissions: ugo+rw Apr 10 12:22:06 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:06 devstack sudo[90464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.info Apr 10 12:22:06 devstack sudo[90464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:07 devstack sudo[90461]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-fa78d84c-a4f7-4680-b2dd-9f715400e6c4" returned: 0 in 0.417s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-fa78d84c-a4f7-4680-b2dd-9f715400e6c4" released by "delete_volume" :: held 0.939s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Created reservations ['f876bd51-65ce-4092-a295-512666b36b53', '0e6a93eb-939e-43c3-b3f1-0ad31816ab97', 'c784b2f1-ba3d-405d-9c30-6fbda89f2601', 'a6082ef3-35ba-4b7b-b681-6d6b0abdef2e'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:07 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:07 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-db93023d-9ba3-45cf-a031-6c1da5fff176-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-db93023d-9ba3-45cf-a031-6c1da5fff176-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:07 devstack sudo[90464]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-quobyte-db93023d-9ba3-45cf-a031-6c1da5fff176" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.info" returned: 0 in 0.480s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.824s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.346s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-db93023d-9ba3-45cf-a031-6c1da5fff176" acquired by "delete_volume" :: waited 0.040s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Creating offline snapshot 4100185e-1c65-411e-a149-fb7289a612ab of volume 8172e189-84b5-42c3-a504-2e8de21772f2 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb32d42-875e-4448-a7d0-338fef3c552d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:07 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ed79ed05-7d3f-4aa5-b1bb-002283c3982a tempest-VolumeDependencyTests-787239053 None] Create snapshot completed successfully Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c100efa-e09a-44c3-9445-3956fbe07b15]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:07 devstack sudo[90470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 Apr 10 12:22:07 devstack sudo[90470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:07 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 Apr 10 12:22:07 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:07 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.449s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:07 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Deleted volume successfully. Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d6d3020e-d7ec-4f7b-bd09-5764f8d69594 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-fa78d84c-a4f7-4680-b2dd-9f715400e6c4-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:07 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:07 devstack sudo[90470]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2" returned: 0 in 0.459s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176" returned: 0 in 0.484s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:07 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:07 devstack sudo[90481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab 1G Apr 10 12:22:07 devstack sudo[90481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:07 devstack sudo[90482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176 Apr 10 12:22:07 devstack sudo[90482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:08 devstack sudo[90482]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-db93023d-9ba3-45cf-a031-6c1da5fff176" returned: 0 in 0.483s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-db93023d-9ba3-45cf-a031-6c1da5fff176" released by "delete_volume" :: held 1.001s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:08 devstack sudo[90481]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab 1G" returned: 0 in 0.536s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8172e189-84b5-42c3-a504-2e8de21772f2 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:08 devstack sudo[90489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8172e189-84b5-42c3-a504-2e8de21772f2 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab Apr 10 12:22:08 devstack sudo[90489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Created reservations ['ef7e725e-45e9-4582-8535-38e47af67b5c', 'c4d2f616-a6b2-4a1b-a561-7108a0088eaf', '403ec7e0-21b1-4413-8272-cb5fcf8a2ba8', '165dc589-079a-432f-bf9e-a6dee82c879c'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:08 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:08 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Flow 'volume_create_manager' (2c819374-aaab-40ac-bf3a-23d6e9651f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e85750-9e4a-47b5-8f1d-63acb679ee32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e85750-9e4a-47b5-8f1d-63acb679ee32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1789163356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c94f95f9-7e6e-40dc-9d55-d6c3237bc720,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9dda212fde440d381c5abd727a14cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c0333b95-7126-4ae2-a55d-2f921708ea1e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:08Z,use_quota=True,user_id='17d2f829bc3d495eac95f364dace4457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd68c86c-5382-484d-8ed8-e001e1c80633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd68c86c-5382-484d-8ed8-e001e1c80633) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e49d857-4399-42a3-96ac-ac67302d14b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e49d857-4399-42a3-96ac-ac67302d14b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c94f95f9-7e6e-40dc-9d55-d6c3237bc720', 'volume_name': 'volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720', 'volume_size': 1, 'snapshot_id': 'c0333b95-7126-4ae2-a55d-2f921708ea1e'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3385e91f-5986-430f-a291-17905027e015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3385e91f-5986-430f-a291-17905027e015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9be386-e828-4f70-888e-f5954ff379cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:08 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Volume c94f95f9-7e6e-40dc-9d55-d6c3237bc720: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720', 'volume_size': 1, 'snapshot_id': 'c0333b95-7126-4ae2-a55d-2f921708ea1e'} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:08 devstack sudo[90489]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8172e189-84b5-42c3-a504-2e8de21772f2 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab" returned: 0 in 0.435s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:08 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab is being set with open permissions: ugo+rw Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:08 devstack sudo[90497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab Apr 10 12:22:08 devstack sudo[90497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:08 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.413s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:08 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Deleted volume successfully. Apr 10 12:22:08 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1e5d68e-752c-41e8-a6b2-9ea333bbcbe6 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-db93023d-9ba3-45cf-a031-6c1da5fff176-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:09 devstack sudo[90497]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab" returned: 0 in 0.411s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:09 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.info Apr 10 12:22:09 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-8d159662-6c34-4d32-8a5c-b02557de48bf-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-8d159662-6c34-4d32-8a5c-b02557de48bf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-quobyte-8d159662-6c34-4d32-8a5c-b02557de48bf" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-8d159662-6c34-4d32-8a5c-b02557de48bf" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77bc6b4-72c0-48a8-8b65-dd19966fc81a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:09 devstack sudo[90502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf Apr 10 12:22:09 devstack sudo[90502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:09 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.info" returned: 0 in 0.437s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:09 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.info is being set with open permissions: ugo+rw Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:09 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.info Apr 10 12:22:09 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:09 devstack sudo[90502]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf" returned: 0 in 0.465s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:09 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:09 devstack sudo[90510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf Apr 10 12:22:09 devstack sudo[90510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:10 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.info" returned: 0 in 0.418s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.780s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.907s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-786045840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4364baa7-249b-468b-a56e-19a8b48fa642,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:01Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Creating volume 4364baa7-249b-468b-a56e-19a8b48fa642 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:10 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:10 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 1073741824 Apr 10 12:22:10 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:10 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9f640d23-47b2-4b89-909b-dc80e5db0bc6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Create snapshot completed successfully Apr 10 12:22:10 devstack sudo[90510]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8d159662-6c34-4d32-8a5c-b02557de48bf" returned: 0 in 0.473s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-8d159662-6c34-4d32-8a5c-b02557de48bf" released by "delete_volume" :: held 0.970s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Created reservations ['eae8307e-ed78-4ef0-8eca-03348136f068', 'eda30ffb-93bd-46f9-8101-f85be5eb31a3', 'e7c0eddd-1518-4cbd-b90a-94aeeaab5841', '1c78a03d-cc73-4053-b3ff-c800db14668d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (a238dc0c-d063-44e7-81da-568edfc0aedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4ae8bd-18bb-48ba-a737-6cd328e0618e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4ae8bd-18bb-48ba-a737-6cd328e0618e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412505919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26da1446-2c86-46c0-8016-5e0c0aecf48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:10Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8d9227-d339-4764-b166-889f9d1ec8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b8d9227-d339-4764-b166-889f9d1ec8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a97dc4-5e10-4fc0-bc9c-b0c18855dec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87a97dc4-5e10-4fc0-bc9c-b0c18855dec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26da1446-2c86-46c0-8016-5e0c0aecf48e', 'volume_name': 'volume-26da1446-2c86-46c0-8016-5e0c0aecf48e', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617aaa91-1d5b-454f-8eeb-af686b1a7dd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617aaa91-1d5b-454f-8eeb-af686b1a7dd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4b431f-48e4-40ca-9505-beca5571bb54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume 26da1446-2c86-46c0-8016-5e0c0aecf48e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26da1446-2c86-46c0-8016-5e0c0aecf48e', 'volume_size': 1} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:10 devstack sudo[90519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:10 devstack sudo[90519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:10 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 1073741824" returned: 0 in 0.594s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:10 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 Apr 10 12:22:10 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (f17e417a-e2f1-4265-86f0-2b3d4d036c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b678fe25-a79c-4769-a93b-c994d7f6156b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b678fe25-a79c-4769-a93b-c994d7f6156b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-763623656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:11Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b90ca99-deb0-4d05-96e6-6a91a08d4240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b90ca99-deb0-4d05-96e6-6a91a08d4240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450a0f3b-9cd2-4a97-8e62-cadbcc6ee2d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (450a0f3b-9cd2-4a97-8e62-cadbcc6ee2d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd93c16c2-84ff-4e4d-93b9-6fbd6ba0d342', 'volume_name': 'volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60cbc18-28d8-40bc-a41b-a323426344ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a60cbc18-28d8-40bc-a41b-a323426344ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63b4f1d-b342-4ccf-a9a3-fcafc2bb8671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342', 'volume_size': 1} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (ce4337b4-4c7a-425e-a759-bcc22e2864e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd85c832-e0a7-41a8-930d-e934a7fe604a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd85c832-e0a7-41a8-930d-e934a7fe604a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665966310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69dd494-7c53-454f-abad-546aa26cf808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:11Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3645c41b-a94b-461b-bb68-50b653611730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3645c41b-a94b-461b-bb68-50b653611730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188804cf-3c96-4461-8d20-5c2dc1e128a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (188804cf-3c96-4461-8d20-5c2dc1e128a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a69dd494-7c53-454f-abad-546aa26cf808', 'volume_name': 'volume-a69dd494-7c53-454f-abad-546aa26cf808', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8831ea62-6374-46da-acbe-048c6c0e7deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8831ea62-6374-46da-acbe-048c6c0e7deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e28aea0-07fe-4ff6-8c61-f70c05becf98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:10 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume a69dd494-7c53-454f-abad-546aa26cf808: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a69dd494-7c53-454f-abad-546aa26cf808', 'volume_size': 1} Apr 10 12:22:10 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (edef00a4-0b14-48f8-816a-145a8931de70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451b06bf-443f-4596-a923-c51bba500154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack sudo[90519]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (451b06bf-443f-4596-a923-c51bba500154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1921952685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc6108d-65dd-42c4-a2f8-ddc92f074df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:11Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7246c3d1-eab5-4b32-b6b5-03f5d645b88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7246c3d1-eab5-4b32-b6b5-03f5d645b88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609be2fe-6a47-4826-8294-895a7ed8dec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609be2fe-6a47-4826-8294-895a7ed8dec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bc6108d-65dd-42c4-a2f8-ddc92f074df8', 'volume_name': 'volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1a7577-b866-4f26-9e07-adf430fa2957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f1a7577-b866-4f26-9e07-adf430fa2957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef8f985-8c9c-4a68-b42f-dc963e8765a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume 8bc6108d-65dd-42c4-a2f8-ddc92f074df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8', 'volume_size': 1} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.588s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642" returned: 0 in 0.516s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] <== create_volume: return (1152ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.868s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-177392437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040722e5-e2c4-4d37-8498-cbe572fba371,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:01Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Creating volume 040722e5-e2c4-4d37-8498-cbe572fba371 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:11 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Deleted volume successfully. Apr 10 12:22:11 devstack sudo[90525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 1073741824 Apr 10 12:22:11 devstack sudo[90525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3dc518-67d4-495f-90b7-9197e320c32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4364baa7-249b-468b-a56e-19a8b48fa642', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b511f33f-52b2-4204-bb64-2a529a6e0c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dce09ca4-65aa-4971-bc2f-7928799f4ae0 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-8d159662-6c34-4d32-8a5c-b02557de48bf-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:11 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume volume-4364baa7-249b-468b-a56e-19a8b48fa642 (4364baa7-249b-468b-a56e-19a8b48fa642): created successfully Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b511f33f-52b2-4204-bb64-2a529a6e0c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (46447e98-6379-4bb3-84ec-60911474668e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:11 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-918985d5-2f05-4bdf-b529-ca5f64e6548b tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created volume successfully. Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (95c83e4e-152e-4c48-9f64-6ac0951805bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b4b775-72df-4ad4-b125-dac71427b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4b4b775-72df-4ad4-b125-dac71427b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699020308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513831af-17ec-4ebd-aaf4-c25b4014459b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:11Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f978cc7f-8135-48b6-9aea-6c28c2150d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f978cc7f-8135-48b6-9aea-6c28c2150d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2061565b-d65f-4c4f-a721-619d26589737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2061565b-d65f-4c4f-a721-619d26589737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '513831af-17ec-4ebd-aaf4-c25b4014459b', 'volume_name': 'volume-513831af-17ec-4ebd-aaf4-c25b4014459b', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b13bbe5-9ee2-4a67-aa21-65114b7b6dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b13bbe5-9ee2-4a67-aa21-65114b7b6dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0584bca-9a6f-40d2-951d-17480754f61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:11 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume 513831af-17ec-4ebd-aaf4-c25b4014459b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-513831af-17ec-4ebd-aaf4-c25b4014459b', 'volume_size': 1} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-ebfec920-9ea9-4778-8565-d4afec2effdf-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-ebfec920-9ea9-4778-8565-d4afec2effdf-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "cinder-quobyte-ebfec920-9ea9-4778-8565-d4afec2effdf" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-ebfec920-9ea9-4778-8565-d4afec2effdf" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d946692d-0e44-4ee2-94b1-ec9433f642ee]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:11 devstack sudo[90530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf Apr 10 12:22:11 devstack sudo[90530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:11 devstack sudo[90525]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 1073741824" returned: 0 in 0.533s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:11 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:11 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 Apr 10 12:22:11 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:12 devstack sudo[90530]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:12 devstack sudo[90537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf Apr 10 12:22:12 devstack sudo[90537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:12 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371" returned: 0 in 0.417s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.721s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-986050408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4944bbb8-da89-4b2e-be4e-ba49276fa20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:01Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Creating volume 4944bbb8-da89-4b2e-be4e-ba49276fa20e {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:12 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8556d21a-dd37-4935-9643-fc92162cc919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040722e5-e2c4-4d37-8498-cbe572fba371', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6f710a-1f80-4be2-8218-764f674479ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:12 devstack sudo[90540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e 1073741824 Apr 10 12:22:12 devstack sudo[90540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:12 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume volume-040722e5-e2c4-4d37-8498-cbe572fba371 (040722e5-e2c4-4d37-8498-cbe572fba371): created successfully Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6f710a-1f80-4be2-8218-764f674479ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (29d7d6a7-4d12-47d7-bedd-011b83c87a0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:12 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a2ca18f0-fa88-469e-a2d7-6cdc6d2afd0e tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created volume successfully. Apr 10 12:22:12 devstack sudo[90537]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-ebfec920-9ea9-4778-8565-d4afec2effdf" returned: 0 in 0.440s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-quobyte-ebfec920-9ea9-4778-8565-d4afec2effdf" released by "delete_volume" :: held 0.943s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Created reservations ['655b67e3-183d-4390-a4f3-eacd078dd5cb', 'b1d1cdfe-d53e-47c3-b9ad-ffd7a24418ef', '5d2847e9-fae8-48d7-b5af-00dc56d5e561', 'ddcd32c7-2b1c-46b5-8a82-1af6b12aa4c0'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:12 devstack sudo[90546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:12 devstack sudo[90546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:12 devstack sudo[90540]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e 1073741824" returned: 0 in 0.553s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:12 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:12 devstack sudo[90548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e Apr 10 12:22:12 devstack sudo[90548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:13 devstack sudo[90546]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.465s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:13 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Deleted volume successfully. Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-5210a05b-41f2-4ee5-b9b9-9b1a6cad6b74 tempest-CreateVolumesFromImageTest-877339255 None] Lock "cinder-ebfec920-9ea9-4778-8565-d4afec2effdf-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:13 devstack sudo[90548]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e" returned: 0 in 0.504s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.088s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.608s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1217767699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15734eb1-96d4-43de-9bb3-d16eb6c3e466,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:02Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Creating volume 15734eb1-96d4-43de-9bb3-d16eb6c3e466 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:13 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb23d4b9-ccbc-47d9-9ea3-c674ba181c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcea0cb-1a03-4ef9-ba78-ede435ba87c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:13 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 1073741824 Apr 10 12:22:13 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:13 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e (4944bbb8-da89-4b2e-be4e-ba49276fa20e): created successfully Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fcea0cb-1a03-4ef9-ba78-ede435ba87c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (97cd4923-316c-42d9-a557-6b0e5475414b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:13 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-2209f5ce-9b5b-40a5-bc2c-e89b84f45742 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created volume successfully. Apr 10 12:22:13 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 1073741824" returned: 0 in 0.583s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:13 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:13 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 Apr 10 12:22:13 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_service.periodic_task [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82546) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:14 devstack sudo[90561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:14 devstack sudo[90561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:14 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466" returned: 0 in 0.471s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.539s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1008122100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9741f97d-e6ea-45ce-9f1e-8f72853bd793,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ec83e5304d8fb90b58e1f544ef11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:02Z,use_quota=True,user_id='259fcd27e76f49b68ee846929cbf32bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Creating volume 9741f97d-e6ea-45ce-9f1e-8f72853bd793 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:14 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75fd8830-1142-4f12-9667-08bf369a7925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5774ab8-76bf-45bc-a1a3-1814b4fcca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:14 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 1073741824 Apr 10 12:22:14 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:14 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 (15734eb1-96d4-43de-9bb3-d16eb6c3e466): created successfully Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5774ab8-76bf-45bc-a1a3-1814b4fcca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (c94488b8-111a-470c-af99-c1156e0f388d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:14 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-99a49ab0-c5d1-4672-aed7-d1d8e052c6af tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created volume successfully. Apr 10 12:22:14 devstack sudo[90561]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.490s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-5eac0717-2afe-4e29-9711-4f4a829fc097 None None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:14 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 1073741824" returned: 0 in 0.564s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:14 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:14 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 Apr 10 12:22:14 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:15 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793" returned: 0 in 0.439s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.925s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-c0333b95-7126-4ae2-a55d-2f921708ea1e-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" by "_create_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57e9055d-9364-49b7-a793-7f26c3fc141e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac6d620-2a6a-4a9e-acf9-0fe26c0d3fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:15 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Volume volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 (9741f97d-e6ea-45ce-9f1e-8f72853bd793): created successfully Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eac6d620-2a6a-4a9e-acf9-0fe26c0d3fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Flow 'volume_create_manager' (e17d45f2-76ba-4ed8-9697-07779154ffd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-c0333b95-7126-4ae2-a55d-2f921708ea1e-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Creating volume c94f95f9-7e6e-40dc-9d55-d6c3237bc720 from snapshot c0333b95-7126-4ae2-a55d-2f921708ea1e {{(pid=82546) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:15 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-191e838f-a15d-4d60-9388-1d0582470bde tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created volume successfully. Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] snapshot: c0333b95-7126-4ae2-a55d-2f921708ea1e, volume: c94f95f9-7e6e-40dc-9d55-d6c3237bc720, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b0a0f4-daa6-43a7-99c2-b5b2ebeaede8]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:15 devstack sudo[90573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e Apr 10 12:22:15 devstack sudo[90573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-9741f97d-e6ea-45ce-9f1e-8f72853bd793-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-9741f97d-e6ea-45ce-9f1e-8f72853bd793-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-quobyte-9741f97d-e6ea-45ce-9f1e-8f72853bd793" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-9741f97d-e6ea-45ce-9f1e-8f72853bd793" acquired by "delete_volume" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[81493b89-31f9-46ce-9591-bf880767d9ee]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:15 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:15 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 Apr 10 12:22:15 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:16 devstack sudo[90573]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e" returned: 0 in 0.528s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[40968d4a-b092-4ba7-a1ff-078da4b68dca]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:16 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 Apr 10 12:22:16 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:16 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793" returned: 0 in 0.506s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:16 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793 Apr 10 12:22:16 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:16 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" returned: 0 in 0.549s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:16 devstack sudo[90590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 Apr 10 12:22:16 devstack sudo[90590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:16 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-9741f97d-e6ea-45ce-9f1e-8f72853bd793" returned: 0 in 0.506s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-9741f97d-e6ea-45ce-9f1e-8f72853bd793" released by "delete_volume" :: held 1.059s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created reservations ['545f581d-5c77-4217-a41f-b83138a2bfb1', '62583314-f83d-4ff8-9fcb-eaf3bf740034', '72a9f907-e2a4-4822-902a-41598bd487a0', 'aec58dbc-0307-44e4-903f-2b5ba99d9732'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:16 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:16 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:16 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-15734eb1-96d4-43de-9bb3-d16eb6c3e466-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-15734eb1-96d4-43de-9bb3-d16eb6c3e466-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-quobyte-15734eb1-96d4-43de-9bb3-d16eb6c3e466" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-15734eb1-96d4-43de-9bb3-d16eb6c3e466" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee86c475-ff11-4fec-aad6-2b5552e2f454]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:18 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.619s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:18 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Deleted volume successfully. Apr 10 12:22:18 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-55b1d7e0-8531-401b-b7b6-294195839111 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-9741f97d-e6ea-45ce-9f1e-8f72853bd793-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:18 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 Apr 10 12:22:18 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:19 devstack sudo[90590]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" returned: 0 in 2.428s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da35b5b-c70a-4586-8ff2-459a4d75e882]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:19 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 Apr 10 12:22:19 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:19 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466" returned: 0 in 0.876s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:19 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466 Apr 10 12:22:19 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:19 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15734eb1-96d4-43de-9bb3-d16eb6c3e466" returned: 0 in 0.464s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:19 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" returned: 0 in 0.707s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399, size 1024.00 MB, duration 2.43 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:22:19 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Converted 1024.00 MB image at 421.52 MB/s Apr 10 12:22:19 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 is being set with open permissions: ugo+rw Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-15734eb1-96d4-43de-9bb3-d16eb6c3e466" released by "delete_volume" :: held 1.426s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:19 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 Apr 10 12:22:19 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created reservations ['73388002-66fc-4fc1-a85d-61086d6ab07e', 'c9671ec1-2ee1-4110-a330-1b07f875d980', '6c7d15f8-e008-4424-8018-404bcb40dffb', '0a7bd408-f58f-43bd-8d12-de848aca08a4'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:19 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:19 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:19 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:20 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" returned: 0 in 0.478s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" released by "_copy_volume_from_snapshot" :: held 4.770s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-c0333b95-7126-4ae2-a55d-2f921708ea1e-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" released by "_create_volume_from_snapshot" :: held 4.792s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.826s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.684s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-412505919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26da1446-2c86-46c0-8016-5e0c0aecf48e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:10Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Creating volume 26da1446-2c86-46c0-8016-5e0c0aecf48e {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:20 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb9be386-e828-4f70-888e-f5954ff379cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720', 'volume_size': 1, 'snapshot_id': 'c0333b95-7126-4ae2-a55d-2f921708ea1e'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76be7bb7-be13-4d5b-b6bc-34d146f674ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:20 devstack sudo[90626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e 1073741824 Apr 10 12:22:20 devstack sudo[90626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:20 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Volume volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 (c94f95f9-7e6e-40dc-9d55-d6c3237bc720): created successfully Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76be7bb7-be13-4d5b-b6bc-34d146f674ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Flow 'volume_create_manager' (2c819374-aaab-40ac-bf3a-23d6e9651f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:20 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-50f7e9b0-199f-4b91-a20b-d52497d6a056 tempest-VolumeDependencyTests-787239053 None] Created volume successfully. Apr 10 12:22:20 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.517s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:20 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Deleted volume successfully. Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-cc656579-bf78-4a2a-83bd-2a4107ea8212 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-15734eb1-96d4-43de-9bb3-d16eb6c3e466-delete_volume" released by "delete_volume" :: held 2.200s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-4944bbb8-da89-4b2e-be4e-ba49276fa20e-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-4944bbb8-da89-4b2e-be4e-ba49276fa20e-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-quobyte-4944bbb8-da89-4b2e-be4e-ba49276fa20e" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-4944bbb8-da89-4b2e-be4e-ba49276fa20e" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[887ff3e7-8cd2-4a42-8556-28543f9776f5]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:20 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e Apr 10 12:22:20 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:20 devstack sudo[90626]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e 1073741824" returned: 0 in 0.529s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:20 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:20 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e Apr 10 12:22:20 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:21 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e" returned: 0 in 0.599s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:21 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e Apr 10 12:22:21 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-c0333b95-7126-4ae2-a55d-2f921708ea1e-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Lock "cinder-c0333b95-7126-4ae2-a55d-2f921708ea1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-c0333b95-7126-4ae2-a55d-2f921708ea1e" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-c0333b95-7126-4ae2-a55d-2f921708ea1e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Deleting offline snapshot c0333b95-7126-4ae2-a55d-2f921708ea1e of volume cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] snapshot_file for this snap is: volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:22:21 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e" returned: 0 in 0.572s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[312d5942-d0dd-4f41-a642-9806472eb462]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.627s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-763623656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:11Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Creating volume d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:21 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f4b431f-48e4-40ca-9505-beca5571bb54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26da1446-2c86-46c0-8016-5e0c0aecf48e', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac53e16-7a06-46fd-9b15-4fba90fc9705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:21 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 1073741824 Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:21 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:21 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume volume-26da1446-2c86-46c0-8016-5e0c0aecf48e (26da1446-2c86-46c0-8016-5e0c0aecf48e): created successfully Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ac53e16-7a06-46fd-9b15-4fba90fc9705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (a238dc0c-d063-44e7-81da-568edfc0aedd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:21 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6aadd367-5aab-4161-a1d5-d8d53ebe8ed8 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created volume successfully. Apr 10 12:22:21 devstack sudo[90644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e Apr 10 12:22:21 devstack sudo[90644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:21 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4944bbb8-da89-4b2e-be4e-ba49276fa20e" returned: 0 in 0.564s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-4944bbb8-da89-4b2e-be4e-ba49276fa20e" released by "delete_volume" :: held 1.200s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created reservations ['12001666-f911-45a2-af4a-f3d101b5b54b', '6ea7b281-1c7f-4114-a166-56fc088dbbad', '955a721c-a4d0-46d8-8fae-0981a17362dc', '522c5eff-ef81-4ff6-a2fb-097cde83bee2'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:21 devstack sudo[90650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:21 devstack sudo[90650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:21 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 1073741824" returned: 0 in 0.538s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:21 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:21 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 Apr 10 12:22:21 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:22 devstack sudo[90644]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e" returned: 0 in 0.622s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f97212-12a9-42b6-80a4-d1fd00ba9a71]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:22 devstack sudo[90657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 Apr 10 12:22:22 devstack sudo[90657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:22 devstack sudo[90650]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:22 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Deleted volume successfully. Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-6a4a6c2e-de6a-45dc-a1a9-dd57f61b2e2d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-4944bbb8-da89-4b2e-be4e-ba49276fa20e-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:22 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342" returned: 0 in 0.510s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] <== create_volume: return (1085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.575s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-665966310',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a69dd494-7c53-454f-abad-546aa26cf808,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:11Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Creating volume a69dd494-7c53-454f-abad-546aa26cf808 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:22 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b63b4f1d-b342-4ccf-a9a3-fcafc2bb8671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29de69b3-d6d1-4c60-9165-c391ed91a2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:22 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 1073741824 Apr 10 12:22:22 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:22 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 (d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342): created successfully Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29de69b3-d6d1-4c60-9165-c391ed91a2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (f17e417a-e2f1-4265-86f0-2b3d4d036c96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:22 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-77ed5daa-3e3b-468f-8550-dd407f6193a1 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created volume successfully. Apr 10 12:22:22 devstack sudo[90657]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-040722e5-e2c4-4d37-8498-cbe572fba371-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" returned: 0 in 0.653s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-040722e5-e2c4-4d37-8498-cbe572fba371-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:22 devstack sudo[90666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e Apr 10 12:22:22 devstack sudo[90666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-quobyte-040722e5-e2c4-4d37-8498-cbe572fba371" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-040722e5-e2c4-4d37-8498-cbe572fba371" acquired by "delete_volume" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c134ba0-c383-4fb7-a1b5-0d5c6738be83]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:22 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:22 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 Apr 10 12:22:22 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:23 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 1073741824" returned: 0 in 0.551s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:23 devstack sudo[90673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 Apr 10 12:22:23 devstack sudo[90673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:23 devstack sudo[90666]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e" returned: 0 in 0.693s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:23 devstack sudo[90681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e Apr 10 12:22:23 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:23 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371" returned: 0 in 0.699s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:23 devstack sudo[90683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371 Apr 10 12:22:23 devstack sudo[90683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:23 devstack sudo[90673]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808" returned: 0 in 0.668s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.554s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1921952685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bc6108d-65dd-42c4-a2f8-ddc92f074df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:11Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Creating volume 8bc6108d-65dd-42c4-a2f8-ddc92f074df8 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:23 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e28aea0-07fe-4ff6-8c61-f70c05becf98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a69dd494-7c53-454f-abad-546aa26cf808', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7546da55-6d81-4b3a-aa62-29b637fad06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:23 devstack sudo[90686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 1073741824 Apr 10 12:22:23 devstack sudo[90686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:23 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume volume-a69dd494-7c53-454f-abad-546aa26cf808 (a69dd494-7c53-454f-abad-546aa26cf808): created successfully Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7546da55-6d81-4b3a-aa62-29b637fad06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (ce4337b4-4c7a-425e-a759-bcc22e2864e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:23 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-b85b0db6-1d50-4280-89a1-bea7285377e6 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created volume successfully. Apr 10 12:22:23 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399.c0333b95-7126-4ae2-a55d-2f921708ea1e" returned: 0 in 0.511s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-c0333b95-7126-4ae2-a55d-2f921708ea1e" released by "_delete_snapshot" :: held 2.591s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" released by "delete_snapshot" :: held 2.613s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:23 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Created reservations ['9a9e57c2-4dee-4deb-9814-93d65db5f127', '573e60eb-a5b9-4385-919b-46c5a9179024', 'a1d5cb26-cdca-4dd3-8cad-79172ea5ccbf', 'ac002766-29a1-40fe-b1bf-3e0e62b72ed4'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:24 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Delete snapshot completed successfully. Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c35560cd-58ac-4948-8632-b30fb486fd1f tempest-VolumeDependencyTests-787239053 None] Lock "cinder-c0333b95-7126-4ae2-a55d-2f921708ea1e-delete_snapshot" released by "delete_snapshot" :: held 2.707s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:24 devstack sudo[90683]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-040722e5-e2c4-4d37-8498-cbe572fba371" returned: 0 in 0.508s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-040722e5-e2c4-4d37-8498-cbe572fba371" released by "delete_volume" :: held 1.233s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created reservations ['f725c4a4-2857-4dec-97b9-41955bccca8b', '7f1acbd2-c7eb-44aa-8470-5cdb90a6ab0b', 'e4868360-40c3-4438-bcd5-715cf8ba6c6d', '112f7af2-4c04-42d6-a641-5f6a9ae70e02'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:24 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:24 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:24 devstack sudo[90686]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 1073741824" returned: 0 in 0.649s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:24 devstack sudo[90696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 Apr 10 12:22:24 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Lock "cinder-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd86df6b-3ca7-4c5d-9b86-ba7ebd4f1bde]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:24 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.535s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:24 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Deleted volume successfully. Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-70df3fc8-80e2-46ec-85c6-559b17481dee tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-040722e5-e2c4-4d37-8498-cbe572fba371-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:24 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 Apr 10 12:22:24 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:24 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.552s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-699020308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=513831af-17ec-4ebd-aaf4-c25b4014459b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e33925833ad4241be97bdd20d2be373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:11Z,use_quota=True,user_id='f1cccb9369394f6fa8b07ad37b9b452a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Creating volume 513831af-17ec-4ebd-aaf4-c25b4014459b {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:24 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:24 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b 1073741824 Apr 10 12:22:24 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef8f985-8c9c-4a68-b42f-dc963e8765a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c651ce49-31ef-4cd1-8724-7e989bc565d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:24 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 (8bc6108d-65dd-42c4-a2f8-ddc92f074df8): created successfully Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c651ce49-31ef-4cd1-8724-7e989bc565d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (edef00a4-0b14-48f8-816a-145a8931de70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-4364baa7-249b-468b-a56e-19a8b48fa642-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:24 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-e9601d8d-0ba6-4bfb-8b9a-72eeaa586092 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created volume successfully. Apr 10 12:22:24 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-4364baa7-249b-468b-a56e-19a8b48fa642-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-quobyte-4364baa7-249b-468b-a56e-19a8b48fa642" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-4364baa7-249b-468b-a56e-19a8b48fa642" acquired by "delete_volume" :: waited 0.006s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[853f6bd9-e3dc-4c45-ba29-c1657996cffd]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:25 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 Apr 10 12:22:25 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:25 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" returned: 0 in 0.604s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:25 devstack sudo[90709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399 Apr 10 12:22:25 devstack sudo[90709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:25 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b 1073741824" returned: 0 in 0.652s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:25 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642" returned: 0 in 0.588s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:25 devstack sudo[90717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b Apr 10 12:22:25 devstack sudo[90717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:25 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642 Apr 10 12:22:25 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:25 devstack sudo[90709]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" returned: 0 in 0.571s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399" released by "delete_volume" :: held 1.211s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Created reservations ['a8cda4e6-964f-467f-a0c5-173e76b76aef', '7bed3cfd-fbfa-476f-baa1-c30cf5a06290', 'd2937b86-8c16-4487-9740-e1e50966bd77', 'bf383f14-6a5a-4a41-a11a-62d1339fa59d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:25 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:25 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:25 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:26 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-4364baa7-249b-468b-a56e-19a8b48fa642" returned: 0 in 0.447s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-4364baa7-249b-468b-a56e-19a8b48fa642" released by "delete_volume" :: held 1.064s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created reservations ['41218414-5572-4765-a0d1-1c7a828708e9', '146050ba-1e37-4597-8474-879ad9ae935e', '2e25c30f-4670-4397-91c2-a8911f68f156', '38949f6f-48c9-434c-afe5-703a651b9e35'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:26 devstack sudo[90717]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b" returned: 0 in 0.537s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0584bca-9a6f-40d2-951d-17480754f61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-513831af-17ec-4ebd-aaf4-c25b4014459b', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c147dc53-ee63-40de-adc7-623acd6758de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:26 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Volume volume-513831af-17ec-4ebd-aaf4-c25b4014459b (513831af-17ec-4ebd-aaf4-c25b4014459b): created successfully Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c147dc53-ee63-40de-adc7-623acd6758de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Flow 'volume_create_manager' (95c83e4e-152e-4c48-9f64-6ac0951805bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:26 devstack sudo[90726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:26 devstack sudo[90726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:26 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-492ef1e7-55d6-45cc-ac63-176e4f599454 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created volume successfully. Apr 10 12:22:26 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.480s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:26 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Deleted volume successfully. Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-dc22da0f-86f1-457c-b412-ac6a8a5303fb tempest-VolumeDependencyTests-787239053 None] Lock "cinder-cf6702cd-119c-4e6a-b8df-6cc3bd3a2399-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-513831af-17ec-4ebd-aaf4-c25b4014459b-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-513831af-17ec-4ebd-aaf4-c25b4014459b-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:26 devstack sudo[90726]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.509s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:26 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Deleted volume successfully. Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-quobyte-513831af-17ec-4ebd-aaf4-c25b4014459b" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a8f0ba81-f36d-474b-afbb-180608b6b33d tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-4364baa7-249b-468b-a56e-19a8b48fa642-delete_volume" released by "delete_volume" :: held 1.742s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-513831af-17ec-4ebd-aaf4-c25b4014459b" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a3347b-6233-4f23-aa24-0fa22bf22714]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:26 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b Apr 10 12:22:26 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Flow 'volume_create_manager' (31ad9b88-1d3d-4643-a11f-ecdced959c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17625355-0c1e-4e9c-9f97-6f45b05e08a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17625355-0c1e-4e9c-9f97-6f45b05e08a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1191946893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c767e1-d751-4b25-9e68-54babee15f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9dda212fde440d381c5abd727a14cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:27Z,use_quota=True,user_id='17d2f829bc3d495eac95f364dace4457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66971c26-3618-4bcc-a112-d18c46ee8061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:26 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66971c26-3618-4bcc-a112-d18c46ee8061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d64b0a0-566a-483b-8d9d-f1b340a436b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d64b0a0-566a-483b-8d9d-f1b340a436b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00c767e1-d751-4b25-9e68-54babee15f45', 'volume_name': 'volume-00c767e1-d751-4b25-9e68-54babee15f45', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260932a9-d08a-46c8-af5c-5e2bf12b4c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (260932a9-d08a-46c8-af5c-5e2bf12b4c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e68ce6-7e8e-4af3-84d2-fd4d9cb35111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:27 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Volume 00c767e1-d751-4b25-9e68-54babee15f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00c767e1-d751-4b25-9e68-54babee15f45', 'volume_size': 1} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1191946893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00c767e1-d751-4b25-9e68-54babee15f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9dda212fde440d381c5abd727a14cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:27Z,use_quota=True,user_id='17d2f829bc3d495eac95f364dace4457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Creating volume 00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:27 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:27 devstack sudo[90732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 1073741824 Apr 10 12:22:27 devstack sudo[90732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-2e7362ee-c450-4d9a-b10a-a1920268e549-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-2e7362ee-c450-4d9a-b10a-a1920268e549-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "cinder-quobyte-2e7362ee-c450-4d9a-b10a-a1920268e549" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-2e7362ee-c450-4d9a-b10a-a1920268e549" acquired by "delete_volume" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fde15dee-3a8e-44dd-95d2-629ca6f7980d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:27 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b" returned: 0 in 0.646s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:27 devstack sudo[90737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 Apr 10 12:22:27 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b Apr 10 12:22:27 devstack sudo[90737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:27 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:27 devstack sudo[90732]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 1073741824" returned: 0 in 0.674s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:27 devstack sudo[90744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 Apr 10 12:22:27 devstack sudo[90744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:27 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-513831af-17ec-4ebd-aaf4-c25b4014459b" returned: 0 in 0.541s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-513831af-17ec-4ebd-aaf4-c25b4014459b" released by "delete_volume" :: held 1.210s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:27 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created reservations ['2ce2c4c9-633b-4b6f-b685-dc505aa417d6', 'e517f586-3f10-4253-8655-1e33de0bb51c', '34605d0d-84d5-4152-8a77-d1b1d9cefb5b', 'e3fcc155-35ec-4df9-9344-d97ec04fcbb9'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:28 devstack sudo[90737]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549" returned: 0 in 0.672s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:28 devstack sudo[90750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549 Apr 10 12:22:28 devstack sudo[90750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:28 devstack sudo[90752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:28 devstack sudo[90752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:28 devstack sudo[90752]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.463s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Deleted volume successfully. Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-24789b91-f2eb-4acb-af02-1f39a5c7a119 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-513831af-17ec-4ebd-aaf4-c25b4014459b-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:28 devstack sudo[90744]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45" returned: 0 in 0.985s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e68ce6-7e8e-4af3-84d2-fd4d9cb35111) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00c767e1-d751-4b25-9e68-54babee15f45', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aa7f69-0a74-4a6c-8e83-da5aba6f73b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:28 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Volume volume-00c767e1-d751-4b25-9e68-54babee15f45 (00c767e1-d751-4b25-9e68-54babee15f45): created successfully Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42aa7f69-0a74-4a6c-8e83-da5aba6f73b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Flow 'volume_create_manager' (31ad9b88-1d3d-4643-a11f-ecdced959c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:28 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7a5eba3c-9f8f-4396-9be4-9689e19a2d35 tempest-VolumeDependencyTests-787239053 None] Created volume successfully. Apr 10 12:22:28 devstack sudo[90750]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-2e7362ee-c450-4d9a-b10a-a1920268e549" returned: 0 in 0.754s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-quobyte-2e7362ee-c450-4d9a-b10a-a1920268e549" released by "delete_volume" :: held 1.465s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Created reservations ['20c9473a-3e35-4817-8bda-bae0d1d6d56f', 'dda7a898-b50e-4cb4-bcd3-7eb45eb65e73', '8ba7c42f-b66b-4715-a25b-c08ce075800b', 'b838ec86-3bd1-4900-9c1b-d8e44313b3ab'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-8bc6108d-65dd-42c4-a2f8-ddc92f074df8-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:28 devstack sudo[90757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:28 devstack sudo[90757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-8bc6108d-65dd-42c4-a2f8-ddc92f074df8-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-quobyte-8bc6108d-65dd-42c4-a2f8-ddc92f074df8" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-8bc6108d-65dd-42c4-a2f8-ddc92f074df8" acquired by "delete_volume" :: waited 0.012s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0fedd7-aceb-4877-94fd-2b3c4c698bd2]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:28 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:29 devstack sudo[90759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 Apr 10 12:22:29 devstack sudo[90759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:29 devstack sudo[90757]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.595s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:29 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Deleted volume successfully. Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-01cd216a-0dfb-4c2c-80b5-a357c8c82259 tempest-CreateVolumesFromSourceVolumeTest-523527269 None] Lock "cinder-2e7362ee-c450-4d9a-b10a-a1920268e549-delete_volume" released by "delete_volume" :: held 2.247s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:29 devstack sudo[90759]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8" returned: 0 in 0.595s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Flow 'volume_create_manager' (17e5145c-4ef9-4016-bd9e-608ba19fc174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303b6568-65fc-463a-8568-a0ed12ab155e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:29 devstack sudo[90765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8 Apr 10 12:22:29 devstack sudo[90765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (303b6568-65fc-463a-8568-a0ed12ab155e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1192430896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1ace144-7688-43e2-a569-f69d5f315822,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9dda212fde440d381c5abd727a14cec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=00c767e1-d751-4b25-9e68-54babee15f45,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:30Z,use_quota=True,user_id='17d2f829bc3d495eac95f364dace4457',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397fb7a1-0232-4100-8b8f-81c0b15242ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (397fb7a1-0232-4100-8b8f-81c0b15242ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9d4905-5840-47e9-8d31-9e071711dfdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d9d4905-5840-47e9-8d31-9e071711dfdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f1ace144-7688-43e2-a569-f69d5f315822', 'volume_name': 'volume-f1ace144-7688-43e2-a569-f69d5f315822', 'volume_size': 1, 'source_volid': '00c767e1-d751-4b25-9e68-54babee15f45', 'source_volstatus': 'available'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5efbd20-e548-43df-aa76-823b66e53d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5efbd20-e548-43df-aa76-823b66e53d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2244ee-a1c9-438e-bec8-3eb964b85d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:29 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Volume f1ace144-7688-43e2-a569-f69d5f315822: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f1ace144-7688-43e2-a569-f69d5f315822', 'volume_size': 1, 'source_volid': '00c767e1-d751-4b25-9e68-54babee15f45', 'source_volstatus': 'available'} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:29 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Cloning volume 00c767e1-d751-4b25-9e68-54babee15f45 to volume f1ace144-7688-43e2-a569-f69d5f315822 Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Creating offline snapshot 0db65b30-62e2-41bd-b673-9e8fdf763434 of volume 00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3bdef2-bc3d-41b3-9479-bbddac8fe6de]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:29 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:29 devstack sudo[90767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 Apr 10 12:22:29 devstack sudo[90767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:30 devstack sudo[90765]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8bc6108d-65dd-42c4-a2f8-ddc92f074df8" returned: 0 in 0.695s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-8bc6108d-65dd-42c4-a2f8-ddc92f074df8" released by "delete_volume" :: held 1.322s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:30 devstack sudo[90767]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45" returned: 0 in 0.570s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:30 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 1G Apr 10 12:22:30 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created reservations ['5130daae-e620-40bc-baa6-6c9aafdd0fc4', 'fb3c083a-552c-402c-8186-cd5a85f9dab4', '2ae32cc8-4bba-46cc-8525-0ca083ba9bc9', 'b70f69ee-0351-4104-96c8-b1d92954633b'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:30 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:30 devstack sudo[90776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:30 devstack sudo[90776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:31 devstack sudo[90776]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.520s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:31 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Deleted volume successfully. Apr 10 12:22:31 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 1G" returned: 0 in 0.731s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c767e1-d751-4b25-9e68-54babee15f45 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d8d47b5c-8d40-4dc1-b979-764501a931e5 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-8bc6108d-65dd-42c4-a2f8-ddc92f074df8-delete_volume" released by "delete_volume" :: held 2.148s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:31 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c767e1-d751-4b25-9e68-54babee15f45 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 Apr 10 12:22:31 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-a69dd494-7c53-454f-abad-546aa26cf808-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-a69dd494-7c53-454f-abad-546aa26cf808-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-quobyte-a69dd494-7c53-454f-abad-546aa26cf808" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-a69dd494-7c53-454f-abad-546aa26cf808" acquired by "delete_volume" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[141d1546-afce-4bd2-b6a7-8849aa77676b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:31 devstack sudo[90784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 Apr 10 12:22:31 devstack sudo[90784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Flow 'volume_create_manager' (dfdba394-9994-4f35-ae19-96abbb32d2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407ba69f-c01d-4a9d-b18a-be058363a313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (407ba69f-c01d-4a9d-b18a-be058363a313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-885800238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5aff43-b60a-4122-8fb1-5b9cf6f8d297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea26f2219a946088a7815dc1efb5e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:31Z,use_quota=True,user_id='7078b9b1d90045f6aac7b8c4becb3f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ebf62d-6d36-4a71-b6f2-710060b7ef08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ebf62d-6d36-4a71-b6f2-710060b7ef08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec5634c-ce49-4d07-bff1-1044c5e381b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ec5634c-ce49-4d07-bff1-1044c5e381b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5aff43-b60a-4122-8fb1-5b9cf6f8d297', 'volume_name': 'volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08978a85-177d-44a4-8a32-f941873c476a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08978a85-177d-44a4-8a32-f941873c476a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18ef32d-e872-46b3-85f4-7515f88c0f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:31 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Volume 5e5aff43-b60a-4122-8fb1-5b9cf6f8d297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297', 'volume_size': 1} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:31 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00c767e1-d751-4b25-9e68-54babee15f45 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434" returned: 0 in 0.674s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:31 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 is being set with open permissions: ugo+rw Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:31 devstack sudo[90789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 Apr 10 12:22:31 devstack sudo[90789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:31 devstack sudo[90784]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808" returned: 0 in 0.633s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:31 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:31 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808 Apr 10 12:22:31 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:32 devstack sudo[90789]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434" returned: 0 in 0.494s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:32 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.info Apr 10 12:22:32 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:32 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-a69dd494-7c53-454f-abad-546aa26cf808" returned: 0 in 0.458s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-a69dd494-7c53-454f-abad-546aa26cf808" released by "delete_volume" :: held 1.143s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Flow 'volume_create_manager' (dc4361b7-5602-44f3-a63c-b40270a6f476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149e051a-4861-49a4-9fa5-8a934f1bf624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (149e051a-4861-49a4-9fa5-8a934f1bf624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95b5e13-d277-4fa1-a171-f3d87c101511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de54ff75ec0344b7bcc25c9c81841a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:32Z,use_quota=True,user_id='67c68c2ca04f42689c6fe145194e1c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313aa917-8bf3-4eaa-a1df-126f029f197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (313aa917-8bf3-4eaa-a1df-126f029f197b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab822ee-d4c7-4dbd-b778-7ef083abda03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dab822ee-d4c7-4dbd-b778-7ef083abda03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e95b5e13-d277-4fa1-a171-f3d87c101511', 'volume_name': 'volume-e95b5e13-d277-4fa1-a171-f3d87c101511', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57097e34-1e7e-4d59-8b4c-31868aebdc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57097e34-1e7e-4d59-8b4c-31868aebdc9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b88e43a-078a-498f-89ff-ba8a987c7488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:32 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Volume e95b5e13-d277-4fa1-a171-f3d87c101511: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e95b5e13-d277-4fa1-a171-f3d87c101511', 'volume_size': 1} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created reservations ['41496b61-0af6-4aed-8949-0dcb28d4d622', 'b6560011-d976-415f-8551-684504a24f16', 'e996ab7e-70d7-48f0-b58f-6f5ab2e7c95e', 'f50448d1-265b-44e9-a132-74f6ff0275bc'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:32 devstack sudo[90800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:32 devstack sudo[90800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:32 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.info" returned: 0 in 0.433s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:32 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.info is being set with open permissions: ugo+rw Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:32 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.info Apr 10 12:22:32 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:32 devstack sudo[90800]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.409s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:32 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Deleted volume successfully. Apr 10 12:22:32 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-d59d95a3-71a5-4216-9d4f-6edee6aa9ef3 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-a69dd494-7c53-454f-abad-546aa26cf808-delete_volume" released by "delete_volume" :: held 1.856s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:33 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.info" returned: 0 in 0.416s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-f1ace144-7688-43e2-a569-f69d5f315822" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-f1ace144-7688-43e2-a569-f69d5f315822" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] snapshot: 0db65b30-62e2-41bd-b673-9e8fdf763434, volume: f1ace144-7688-43e2-a569-f69d5f315822, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c13739d-835c-4cd6-8f99-6b0338bb0e37]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:33 devstack sudo[90807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 Apr 10 12:22:33 devstack sudo[90807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-quobyte-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342" acquired by "delete_volume" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b97e66-1ce1-438b-9b78-dda49356de72]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:33 devstack sudo[90809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 Apr 10 12:22:33 devstack sudo[90809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:33 devstack sudo[90807]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434" returned: 0 in 0.509s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00c767e1-d751-4b25-9e68-54babee15f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[05224564-313c-4cc8-a2dc-f4d490a1c19e]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:33 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 Apr 10 12:22:33 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:33 devstack sudo[90809]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342" returned: 0 in 0.510s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:33 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:33 devstack sudo[90819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342 Apr 10 12:22:33 devstack sudo[90819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:34 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45" returned: 0 in 0.481s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:34 devstack sudo[90825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 Apr 10 12:22:34 devstack sudo[90825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:34 devstack sudo[90819]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342" returned: 0 in 0.431s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342" released by "delete_volume" :: held 0.962s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Created reservations ['17522461-b7c5-4245-a836-be8f2ae0ec25', 'f982e965-912b-48a3-a996-d47716c3eaee', '571091aa-7037-44f0-a8d1-e19a2fd1cdbd', '2d31e6f8-de49-4ea8-8c8b-986bfbbaf13d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:34 devstack sudo[90828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:34 devstack sudo[90828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-26da1446-2c86-46c0-8016-5e0c0aecf48e-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-26da1446-2c86-46c0-8016-5e0c0aecf48e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-quobyte-26da1446-2c86-46c0-8016-5e0c0aecf48e" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-26da1446-2c86-46c0-8016-5e0c0aecf48e" acquired by "delete_volume" :: waited 0.017s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[5614b8fc-4329-4902-b30c-f536096a2d14]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:34 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:34 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e Apr 10 12:22:34 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:35 devstack sudo[90828]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 1.405s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:35 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:35 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Deleted volume successfully. Apr 10 12:22:35 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:35 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-a399bc2a-f2d1-4161-b62b-99cd294a7b46 tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-d93c16c2-84ff-4e4d-93b9-6fbd6ba0d342-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e" returned: 0 in 1.343s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:35 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:35 devstack sudo[90846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e Apr 10 12:22:35 devstack sudo[90846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:36 devstack sudo[90825]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822" returned: 0 in 2.229s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6828a8-e4b7-483a-9ed6-2d1affba9b4a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:36 devstack sudo[90848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 Apr 10 12:22:36 devstack sudo[90848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:36 devstack sudo[90846]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-26da1446-2c86-46c0-8016-5e0c0aecf48e" returned: 0 in 0.725s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-26da1446-2c86-46c0-8016-5e0c0aecf48e" released by "delete_volume" :: held 2.097s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Created reservations ['ea34d341-b995-49a9-9450-e5ce3a90e48d', '7797a1d2-182e-46ba-b563-2c64fdf916fe', '54c43630-3f92-4cba-a2d8-45d238ecd5c3', '05cc8059-7c10-4463-b006-c05165ca5d4d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:36 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:36 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-4100185e-1c65-411e-a149-fb7289a612ab-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-4100185e-1c65-411e-a149-fb7289a612ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-quobyte-8172e189-84b5-42c3-a504-2e8de21772f2" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-8172e189-84b5-42c3-a504-2e8de21772f2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-quobyte-4100185e-1c65-411e-a149-fb7289a612ab" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-4100185e-1c65-411e-a149-fb7289a612ab" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Deleting offline snapshot 4100185e-1c65-411e-a149-fb7289a612ab of volume 8172e189-84b5-42c3-a504-2e8de21772f2 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] snapshot_file for this snap is: volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9898ab-2c4a-4d13-9048-df8a5c54fea5]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:36 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:36 devstack sudo[90855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab Apr 10 12:22:36 devstack sudo[90855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:37 devstack sudo[90848]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45" returned: 0 in 0.680s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:22:37 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Converted 1024.00 MB image at 459.10 MB/s Apr 10 12:22:37 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 is being set with open permissions: ugo+rw Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:37 devstack sudo[90858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 Apr 10 12:22:37 devstack sudo[90858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:37 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.580s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:37 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Deleted volume successfully. Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-c1269f1d-fe4a-41df-8f60-99c9cbf1a30f tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-26da1446-2c86-46c0-8016-5e0c0aecf48e-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:37 devstack sudo[90855]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab" returned: 0 in 0.582s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8172e189-84b5-42c3-a504-2e8de21772f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8be72d-814f-449c-9942-f79986876e65]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:37 devstack sudo[90858]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822" returned: 0 in 0.441s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-f1ace144-7688-43e2-a569-f69d5f315822" released by "_copy_volume_from_snapshot" :: held 4.387s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:37 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 Apr 10 12:22:37 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-0db65b30-62e2-41bd-b673-9e8fdf763434" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-0db65b30-62e2-41bd-b673-9e8fdf763434" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Deleting offline snapshot 0db65b30-62e2-41bd-b673-9e8fdf763434 of volume 00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] snapshot_file for this snap is: volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[1517a728-70c8-4de2-9340-1d214810ec26]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:37 devstack sudo[90867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 Apr 10 12:22:37 devstack sudo[90867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:37 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2" returned: 0 in 0.506s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:37 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:37 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab Apr 10 12:22:37 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:38 devstack sudo[90867]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434" returned: 0 in 0.501s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00c767e1-d751-4b25-9e68-54babee15f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb5e6123-250f-4416-84ce-bff7bb50db9a]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:38 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 Apr 10 12:22:38 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:38 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab" returned: 0 in 0.468s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:38 devstack sudo[90882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab Apr 10 12:22:38 devstack sudo[90882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:38 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45" returned: 0 in 0.469s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:38 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 Apr 10 12:22:38 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:38 devstack sudo[90882]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2.4100185e-1c65-411e-a149-fb7289a612ab" returned: 0 in 0.417s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-4100185e-1c65-411e-a149-fb7289a612ab" released by "_delete_snapshot" :: held 2.039s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-8172e189-84b5-42c3-a504-2e8de21772f2" released by "delete_snapshot" :: held 2.055s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Created reservations ['8c27f291-49c6-4a60-b96b-3a552191a76a', '85e844f4-b4ab-40e9-bb77-e5348a438063', '27041efb-392d-4cfe-a160-626b0d3c357a', '96d4240b-ad25-4ab1-af89-ee53bce9a968'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:38 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Delete snapshot completed successfully. Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-9080a46b-f147-4048-849b-74bdc7986cac tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-4100185e-1c65-411e-a149-fb7289a612ab-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:38 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434" returned: 0 in 0.484s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:38 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:39 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434 Apr 10 12:22:39 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:39 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45.0db65b30-62e2-41bd-b673-9e8fdf763434" returned: 0 in 0.422s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-0db65b30-62e2-41bd-b673-9e8fdf763434" released by "_delete_snapshot" :: held 1.921s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.749s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.931s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-885800238',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5aff43-b60a-4122-8fb1-5b9cf6f8d297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea26f2219a946088a7815dc1efb5e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:31Z,use_quota=True,user_id='7078b9b1d90045f6aac7b8c4becb3f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Creating volume 5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:39 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a2244ee-a1c9-438e-bec8-3eb964b85d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1ace144-7688-43e2-a569-f69d5f315822', 'volume_size': 1, 'source_volid': '00c767e1-d751-4b25-9e68-54babee15f45', 'source_volstatus': 'available'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:39 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 1073741824 Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6407523-9e0e-423d-965b-ccd2a782e147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:39 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:39 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Volume volume-f1ace144-7688-43e2-a569-f69d5f315822 (f1ace144-7688-43e2-a569-f69d5f315822): created successfully Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6407523-9e0e-423d-965b-ccd2a782e147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Flow 'volume_create_manager' (17e5145c-4ef9-4016-bd9e-608ba19fc174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:39 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-229f6930-c12b-4566-9447-32734d6a75ce tempest-VolumeDependencyTests-787239053 None] Created volume successfully. Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-8172e189-84b5-42c3-a504-2e8de21772f2-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-8172e189-84b5-42c3-a504-2e8de21772f2-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "cinder-quobyte-8172e189-84b5-42c3-a504-2e8de21772f2" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-8172e189-84b5-42c3-a504-2e8de21772f2" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[be459ef4-063c-43a2-991d-cf840e04fe91]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:39 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:40 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 1073741824" returned: 0 in 0.547s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:40 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 Apr 10 12:22:40 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:40 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 Apr 10 12:22:40 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-00c767e1-d751-4b25-9e68-54babee15f45-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-00c767e1-d751-4b25-9e68-54babee15f45-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-00c767e1-d751-4b25-9e68-54babee15f45" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-00c767e1-d751-4b25-9e68-54babee15f45" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7e22b9-cb53-4b3d-a1f6-276abdf671cb]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:40 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 Apr 10 12:22:40 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:40 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" returned: 0 in 0.450s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.039s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.999s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:32Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e95b5e13-d277-4fa1-a171-f3d87c101511,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de54ff75ec0344b7bcc25c9c81841a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:32Z,use_quota=True,user_id='67c68c2ca04f42689c6fe145194e1c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Creating volume e95b5e13-d277-4fa1-a171-f3d87c101511 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:40 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a18ef32d-e872-46b3-85f4-7515f88c0f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:40 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73405da-4cf3-46ac-a687-8bef4efa3e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:40 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 1073741824 Apr 10 12:22:40 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2" returned: 0 in 0.545s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:40 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Volume volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 (5e5aff43-b60a-4122-8fb1-5b9cf6f8d297): created successfully Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d73405da-4cf3-46ac-a687-8bef4efa3e8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Flow 'volume_create_manager' (dfdba394-9994-4f35-ae19-96abbb32d2fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:40 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2 Apr 10 12:22:40 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:40 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3751fe2a-6186-4d06-af47-5dd22b1a9837 tempest-SnapshotDependencyTests-1144936018 None] Created volume successfully. Apr 10 12:22:40 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45" returned: 0 in 0.529s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:40 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:40 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45 Apr 10 12:22:40 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:41 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-8172e189-84b5-42c3-a504-2e8de21772f2" returned: 0 in 0.477s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-quobyte-8172e189-84b5-42c3-a504-2e8de21772f2" released by "delete_volume" :: held 1.066s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:41 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 1073741824" returned: 0 in 0.542s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Created reservations ['84d17d7a-2b10-4bb2-9d01-79f84a7a511c', '26d95766-c756-4567-b429-58203320bcc4', 'f452f698-f8b6-43fd-974a-3acd6839732b', 'ef7f559f-d0c0-4d9e-948e-52ac77022ab4'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:41 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 Apr 10 12:22:41 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:41 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:41 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:41 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-00c767e1-d751-4b25-9e68-54babee15f45" returned: 0 in 0.568s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-00c767e1-d751-4b25-9e68-54babee15f45" released by "delete_volume" :: held 1.145s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:41 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511" returned: 0 in 0.452s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.306s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Creating offline snapshot 2bc5edfe-49d2-432a-bb38-9842585e605e of volume 5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b88e43a-078a-498f-89ff-ba8a987c7488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e95b5e13-d277-4fa1-a171-f3d87c101511', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d09d76-fba8-4b34-b3cb-ff1a1e932ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[7988e920-12a0-4b95-b0b9-0e985a1a81b0]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:41 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Volume volume-e95b5e13-d277-4fa1-a171-f3d87c101511 (e95b5e13-d277-4fa1-a171-f3d87c101511): created successfully Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d09d76-fba8-4b34-b3cb-ff1a1e932ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Flow 'volume_create_manager' (dc4361b7-5602-44f3-a63c-b40270a6f476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-189a8549-de5a-4145-a0ff-e2dfb5e7366e tempest-CinderUnicodeTest-1946710190 None] Created volume successfully. Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Created reservations ['6ab7104f-4aa2-47ac-b749-2e0aa1ca5973', 'd187b3d8-b365-480d-a2c7-809ada32891c', '6948f096-3162-49f4-b249-7e5013f465eb', 'ae6f14fd-5503-4b77-be9c-1cbf29946b4d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:41 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 Apr 10 12:22:41 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:41 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:41 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Deleted volume successfully. Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:41 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-1b8a6732-78df-4ecc-8d18-5a3689d85edc tempest-CreateVolumesFromSnapshotTest-401659474 None] Lock "cinder-8172e189-84b5-42c3-a504-2e8de21772f2-delete_volume" released by "delete_volume" :: held 1.759s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:41 devstack sudo[90934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:41 devstack sudo[90934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:42 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" returned: 0 in 0.496s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:42 devstack sudo[90934]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:42 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e 1G Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.417s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:42 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:42 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Deleted volume successfully. Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-3eca29f2-b74d-4aa5-bc4b-feb39360e3d2 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-00c767e1-d751-4b25-9e68-54babee15f45-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-f1ace144-7688-43e2-a569-f69d5f315822-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Lock "cinder-f1ace144-7688-43e2-a569-f69d5f315822-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Flow 'volume_create_manager' (664956e1-02d7-45f6-969b-a8caa4e91a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed13dc08-969b-44ac-9f7c-73e0b7b7e8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed13dc08-969b-44ac-9f7c-73e0b7b7e8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1113665834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589faec8-dbdc-4d13-93c1-774ecf1f50e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de54ff75ec0344b7bcc25c9c81841a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:42Z,use_quota=True,user_id='67c68c2ca04f42689c6fe145194e1c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7583a12-32f2-46b7-8fdc-ecd81b8b53b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7583a12-32f2-46b7-8fdc-ecd81b8b53b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c87f99-9a09-4190-befb-cc0833a0a772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2c87f99-9a09-4190-befb-cc0833a0a772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '589faec8-dbdc-4d13-93c1-774ecf1f50e3', 'volume_name': 'volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db44e5a-86d9-48b9-b321-08779af4b036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db44e5a-86d9-48b9-b321-08779af4b036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18bfc9f-8c80-409c-9e51-24fdff6603c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:42 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Volume 589faec8-dbdc-4d13-93c1-774ecf1f50e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3', 'volume_size': 1} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-f1ace144-7688-43e2-a569-f69d5f315822" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-f1ace144-7688-43e2-a569-f69d5f315822" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2af82f-8daf-4d32-bcbe-4bf93d7fa4ec]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:42 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e 1G" returned: 0 in 0.639s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:42 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:42 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e Apr 10 12:22:42 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:42 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 Apr 10 12:22:42 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:43 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822" returned: 0 in 0.554s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:43 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e" returned: 0 in 0.531s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:43 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e is being set with open permissions: ugo+rw Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:43 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822 Apr 10 12:22:43 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:43 devstack sudo[90956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e Apr 10 12:22:43 devstack sudo[90956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:43 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-f1ace144-7688-43e2-a569-f69d5f315822" returned: 0 in 0.428s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-f1ace144-7688-43e2-a569-f69d5f315822" released by "delete_volume" :: held 1.005s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:43 devstack sudo[90956]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e" returned: 0 in 0.434s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Created reservations ['f4201343-14b2-48dc-91d7-0bf600060b3b', '9bbf9c28-bd7c-434d-87a8-b3d1fc8e9341', '88c1a226-fafc-447f-bf30-cbe7c3ef97d4', 'f37aeae1-b140-4d6d-a0bc-80c0954c1b64'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:43 devstack sudo[90961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.info Apr 10 12:22:43 devstack sudo[90961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:43 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:43 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:43 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:44 devstack sudo[90961]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.info" returned: 0 in 0.412s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:44 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.info is being set with open permissions: ugo+rw Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:44 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.info Apr 10 12:22:44 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:44 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.411s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:44 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Deleted volume successfully. Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-44bd15ac-8e54-4f98-ac42-d00c394e00ce tempest-VolumeDependencyTests-787239053 None] Lock "cinder-f1ace144-7688-43e2-a569-f69d5f315822-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:44 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.info" returned: 0 in 0.423s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.002s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:42Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1113665834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=589faec8-dbdc-4d13-93c1-774ecf1f50e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de54ff75ec0344b7bcc25c9c81841a28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:42Z,use_quota=True,user_id='67c68c2ca04f42689c6fe145194e1c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)}" {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Creating volume 589faec8-dbdc-4d13-93c1-774ecf1f50e3 {{(pid=82546) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:44 devstack cinder-volume[82546]: INFO cinder.volume.drivers.remotefs [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] casted to osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 1073741824 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:44 devstack sudo[90977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 1073741824 Apr 10 12:22:44 devstack sudo[90977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:44 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f9aebd5b-7ce1-426a-a5d9-d148b200692b tempest-SnapshotDependencyTests-1144936018 None] Create snapshot completed successfully Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-c94f95f9-7e6e-40dc-9d55-d6c3237bc720-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-c94f95f9-7e6e-40dc-9d55-d6c3237bc720-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "cinder-quobyte-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[856af2e9-8afc-48c8-bcbb-7cc88a8894bf]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:44 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:44 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 Apr 10 12:22:44 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:45 devstack sudo[90977]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 1073741824" returned: 0 in 0.501s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:45 devstack sudo[90984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 Apr 10 12:22:45 devstack sudo[90984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:45 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" returned: 0 in 0.493s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:45 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720 Apr 10 12:22:45 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:45 devstack sudo[90984]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3" returned: 0 in 0.473s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'} {{(pid=82546) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18bfc9f-8c80-409c-9e51-24fdff6603c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3', 'volume_size': 1}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb9d770-31a0-46f9-a0d0-62977c8bca98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:45 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Volume volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 (589faec8-dbdc-4d13-93c1-774ecf1f50e3): created successfully Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfb9d770-31a0-46f9-a0d0-62977c8bca98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Flow 'volume_create_manager' (664956e1-02d7-45f6-969b-a8caa4e91a7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:45 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-11812d61-519d-43cc-a8f8-39a638aac959 tempest-CinderUnicodeTest-1946710190 None] Created volume successfully. Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82546) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 10 12:22:45 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Flow 'volume_create_manager' (e97f2528-3d0c-4030-99a2-4e9e3bf3750e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab76cdb-c482-4d8a-8781-8bb615f1fb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" returned: 0 in 0.486s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab76cdb-c482-4d8a-8781-8bb615f1fb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-10T10:22:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15152235-73e5-494b-b99f-9d67a9d0420a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ea26f2219a946088a7815dc1efb5e50',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-10T10:22:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2bc5edfe-49d2-432a-bb38-9842585e605e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-10T10:22:46Z,use_quota=True,user_id='7078b9b1d90045f6aac7b8c4becb3f1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7e3a0de1-9f3d-407e-8c70-58548efb75bd),volume_type_id=7e3a0de1-9f3d-407e-8c70-58548efb75bd)' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5995a11-a54f-42db-9935-bb7e722923fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5995a11-a54f-42db-9935-bb7e722923fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a323fbd-7784-4ea3-a40a-3770cd844e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a323fbd-7784-4ea3-a40a-3770cd844e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15152235-73e5-494b-b99f-9d67a9d0420a', 'volume_name': 'volume-15152235-73e5-494b-b99f-9d67a9d0420a', 'volume_size': 1, 'snapshot_id': '2bc5edfe-49d2-432a-bb38-9842585e605e'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3de599-748f-441b-846d-d04e2262c295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3de599-748f-441b-846d-d04e2262c295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0616e53-d128-4687-bbc3-7177c604dfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:45 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Volume 15152235-73e5-494b-b99f-9d67a9d0420a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15152235-73e5-494b-b99f-9d67a9d0420a', 'volume_size': 1, 'snapshot_id': '2bc5edfe-49d2-432a-bb38-9842585e605e'} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-quobyte-c94f95f9-7e6e-40dc-9d55-d6c3237bc720" released by "delete_volume" :: held 1.035s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-quobyte-2bc5edfe-49d2-432a-bb38-9842585e605e-15152235-73e5-494b-b99f-9d67a9d0420a" by "_create_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-2bc5edfe-49d2-432a-bb38-9842585e605e-15152235-73e5-494b-b99f-9d67a9d0420a" acquired by "_create_volume_from_snapshot" :: waited 0.011s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Creating volume 15152235-73e5-494b-b99f-9d67a9d0420a from snapshot 2bc5edfe-49d2-432a-bb38-9842585e605e {{(pid=82546) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Selected osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196 as target Quobyte volume. {{(pid=82546) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-quobyte-15152235-73e5-494b-b99f-9d67a9d0420a" by "_copy_volume_from_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-15152235-73e5-494b-b99f-9d67a9d0420a" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] snapshot: 2bc5edfe-49d2-432a-bb38-9842585e605e, volume: 15152235-73e5-494b-b99f-9d67a9d0420a, {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a274ad-87d7-4552-948b-d4a04d9cf0ed]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Created reservations ['42539b2e-1c12-4c6b-a297-801a94e4ad8c', 'ca0972f4-8d78-415f-8ef6-038392196e1a', 'aa6ccff4-4094-4dc6-9cca-9b10f3682c7d', '9abe22d7-1720-465c-b626-a6ac0138e44d'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:45 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:45 devstack sudo[90994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:45 devstack sudo[90994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:45 devstack sudo[90993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e Apr 10 12:22:45 devstack sudo[90993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:46 devstack sudo[90993]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e" returned: 0 in 0.485s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:22:46 devstack sudo[90994]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Creating direct copy from snapshot {{(pid=82546) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.432s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2aa98f-1449-4ce3-9af7-7e6f40100f05]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:46 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Deleted volume successfully. Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-f9025eb6-798f-4822-902f-948ffe8ef331 tempest-VolumeDependencyTests-787239053 None] Lock "cinder-c94f95f9-7e6e-40dc-9d55-d6c3237bc720-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:46 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 Apr 10 12:22:46 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:46 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" returned: 0 in 0.489s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG cinder.utils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Path /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a not found in is_blk_device check {{(pid=82546) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 10 12:22:46 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:46 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a Apr 10 12:22:46 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:49 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a" returned: 0 in 2.281s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:49 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b30c18-9bbb-4281-b6b2-95ec0fa836ae]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:49 devstack sudo[91018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 Apr 10 12:22:49 devstack sudo[91018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:49 devstack sudo[91018]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" returned: 0 in 0.595s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:49 devstack cinder-volume[82546]: DEBUG cinder.image.image_utils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Image conversion details: src /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297, size 1024.00 MB, duration 2.28 sec, destination /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a {{(pid=82546) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 10 12:22:49 devstack cinder-volume[82546]: INFO cinder.image.image_utils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Converted 1024.00 MB image at 448.65 MB/s Apr 10 12:22:49 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a is being set with open permissions: ugo+rw Apr 10 12:22:49 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:49 devstack sudo[91023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a Apr 10 12:22:49 devstack sudo[91023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:50 devstack sudo[91023]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a" returned: 0 in 0.426s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-15152235-73e5-494b-b99f-9d67a9d0420a" released by "_copy_volume_from_snapshot" :: held 4.340s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-2bc5edfe-49d2-432a-bb38-9842585e605e-15152235-73e5-494b-b99f-9d67a9d0420a" released by "_create_volume_from_snapshot" :: held 4.370s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.381s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.276s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Creating offline snapshot 4262610b-c15e-43b2-9228-2e305c46dacb of volume 589faec8-dbdc-4d13-93c1-774ecf1f50e3 {{(pid=82546) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[087fd549-173a-43d7-9761-a339be2ddd08]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0616e53-d128-4687-bbc3-7177c604dfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15152235-73e5-494b-b99f-9d67a9d0420a', 'volume_size': 1, 'snapshot_id': '2bc5edfe-49d2-432a-bb38-9842585e605e'}' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35dd0acf-22e7-4e44-8275-f97ac5b78e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 10 12:22:50 devstack cinder-volume[82546]: INFO cinder.volume.flows.manager.create_volume [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Volume volume-15152235-73e5-494b-b99f-9d67a9d0420a (15152235-73e5-494b-b99f-9d67a9d0420a): created successfully Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35dd0acf-22e7-4e44-8275-f97ac5b78e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82546) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Flow 'volume_create_manager' (e97f2528-3d0c-4030-99a2-4e9e3bf3750e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82546) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 10 12:22:50 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-bfff6ffa-1797-45b4-bcce-fd39f8fd1f31 tempest-SnapshotDependencyTests-1144936018 None] Created volume successfully. Apr 10 12:22:50 devstack sudo[91026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 Apr 10 12:22:50 devstack sudo[91026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:50 devstack sudo[91026]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3" returned: 0 in 0.473s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:50 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb 1G {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:50 devstack sudo[91031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb 1G Apr 10 12:22:50 devstack sudo[91031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-2bc5edfe-49d2-432a-bb38-9842585e605e-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-2bc5edfe-49d2-432a-bb38-9842585e605e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-quobyte-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" acquired by "delete_snapshot" :: waited 0.005s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-quobyte-2bc5edfe-49d2-432a-bb38-9842585e605e" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-2bc5edfe-49d2-432a-bb38-9842585e605e" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Deleting offline snapshot 2bc5edfe-49d2-432a-bb38-9842585e605e of volume 5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] snapshot_file for this snap is: volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[22058e57-4d4c-4dfc-ae24-d18b13375f0d]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:51 devstack sudo[91036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e Apr 10 12:22:51 devstack sudo[91036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:51 devstack sudo[91031]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb 1G" returned: 0 in 0.508s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:51 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb Apr 10 12:22:51 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:51 devstack sudo[91036]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e" returned: 0 in 0.464s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec23a8b2-82b5-4a45-a070-ed324aaf62ad]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:51 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 -F qcow2 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb" returned: 0 in 0.430s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:51 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb is being set with open permissions: ugo+rw Apr 10 12:22:51 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:51 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb Apr 10 12:22:51 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:51 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 Apr 10 12:22:51 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:52 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb" returned: 0 in 0.417s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:52 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.info Apr 10 12:22:52 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:52 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" returned: 0 in 0.506s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:52 devstack sudo[91088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e Apr 10 12:22:52 devstack sudo[91088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:52 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.info" returned: 0 in 0.442s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:52 devstack cinder-volume[82546]: WARNING cinder.volume.drivers.remotefs [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.info is being set with open permissions: ugo+rw Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.info {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:52 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.info Apr 10 12:22:52 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:52 devstack sudo[91088]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e" returned: 0 in 0.473s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:52 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e Apr 10 12:22:52 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:52 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.info" returned: 0 in 0.412s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.751s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:52 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-fb4dab33-27be-492b-81e8-f4583fb8ffb4 tempest-CinderUnicodeTest-1946710190 None] Create snapshot completed successfully Apr 10 12:22:52 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:52 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297.2bc5edfe-49d2-432a-bb38-9842585e605e" returned: 0 in 0.423s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-2bc5edfe-49d2-432a-bb38-9842585e605e" released by "_delete_snapshot" :: held 1.915s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" released by "delete_snapshot" :: held 1.927s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Created reservations ['df899731-ead5-47c2-a18a-af98dee53acb', 'e10b2375-210a-432e-935a-b65ff86e8dcd', '45f225c0-5d22-4ea9-befa-095722fbab59', '0f8efcf1-6615-474f-ae34-a0809b54854c'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:53 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Delete snapshot completed successfully. Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7e10e4a2-d5aa-4e88-ba49-c6a4293c531b tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-2bc5edfe-49d2-432a-bb38-9842585e605e-delete_snapshot" released by "delete_snapshot" :: held 2.007s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "cinder-4262610b-c15e-43b2-9228-2e305c46dacb-delete_snapshot" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-4262610b-c15e-43b2-9228-2e305c46dacb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "cinder-quobyte-589faec8-dbdc-4d13-93c1-774ecf1f50e3" by "delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-quobyte-589faec8-dbdc-4d13-93c1-774ecf1f50e3" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "cinder-quobyte-4262610b-c15e-43b2-9228-2e305c46dacb" by "_delete_snapshot" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-quobyte-4262610b-c15e-43b2-9228-2e305c46dacb" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Deleting offline snapshot 4262610b-c15e-43b2-9228-2e305c46dacb of volume 589faec8-dbdc-4d13-93c1-774ecf1f50e3 {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] snapshot_file for this snap is: volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb {{(pid=82546) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[941e2c36-6b36-40cc-8959-ffc7373f5a29]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-quobyte-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" acquired by "delete_volume" :: waited 0.007s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:53 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb Apr 10 12:22:53 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c54491-6fea-4422-a26b-c4fee29e344c]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:53 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 Apr 10 12:22:53 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:53 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb" returned: 0 in 0.472s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.remotefs [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82546) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac35367d-fe25-47b5-a9c3-0b97e78347fd]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:53 devstack sudo[91112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 Apr 10 12:22:53 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:53 devstack sudo[91112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" returned: 0 in 0.479s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:53 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:53 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297 Apr 10 12:22:53 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:54 devstack sudo[91112]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3" returned: 0 in 0.469s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:54 devstack sudo[91121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb Apr 10 12:22:54 devstack sudo[91121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:54 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" returned: 0 in 0.434s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297" released by "delete_volume" :: held 0.943s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Created reservations ['3b61dcc5-31c0-46f9-b18e-72e22a72c998', '81e52f3e-468b-4d7f-b046-43bf64430008', '1301f05e-0ea9-4bd0-af89-ed0d9e30b677', '1f666f34-aa3f-45f6-8d99-ce60fa02f33f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:54 devstack sudo[91123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:54 devstack sudo[91123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-15152235-73e5-494b-b99f-9d67a9d0420a-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-15152235-73e5-494b-b99f-9d67a9d0420a-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=196,cinder:UPDATE=257,cinder:INSERT=65,cinder:DELETE=24 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "cinder-quobyte-15152235-73e5-494b-b99f-9d67a9d0420a" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-15152235-73e5-494b-b99f-9d67a9d0420a" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e53b476-c657-4770-a978-cb9c59b43227]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:54 devstack sudo[91125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a Apr 10 12:22:54 devstack sudo[91125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:54 devstack sudo[91121]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb" returned: 0 in 0.495s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:54 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb Apr 10 12:22:54 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:54 devstack sudo[91123]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.420s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:54 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Deleted volume successfully. Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-ca2d36c3-d072-4553-9e25-cb6279678922 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-5e5aff43-b60a-4122-8fb1-5b9cf6f8d297-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:54 devstack sudo[91125]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a" returned: 0 in 0.505s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:54 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:54 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a Apr 10 12:22:54 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:55 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3.4262610b-c15e-43b2-9228-2e305c46dacb" returned: 0 in 0.430s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:UPDATE=291,cinder:SELECT=197,cinder:INSERT=64,cinder:DELETE=26 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-quobyte-4262610b-c15e-43b2-9228-2e305c46dacb" released by "_delete_snapshot" :: held 1.930s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-quobyte-589faec8-dbdc-4d13-93c1-774ecf1f50e3" released by "delete_snapshot" :: held 1.946s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Created reservations ['7bc94995-c354-4d04-a5ef-13d03144257b', '8ffa9b25-be88-4e1a-95bf-df1f892a131b', '5a22fd80-c2e7-4628-a3f8-a6ec3921508b', '8ea705af-fb99-4bb1-8b7a-e06c436c6753'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Delete snapshot completed successfully. Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-7aaf7dd0-fc58-41e0-9867-68d0c6423fa5 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-4262610b-c15e-43b2-9228-2e305c46dacb-delete_snapshot" released by "delete_snapshot" :: held 2.029s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "cinder-589faec8-dbdc-4d13-93c1-774ecf1f50e3-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-589faec8-dbdc-4d13-93c1-774ecf1f50e3-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "cinder-quobyte-589faec8-dbdc-4d13-93c1-774ecf1f50e3" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:55 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-quobyte-589faec8-dbdc-4d13-93c1-774ecf1f50e3" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-15152235-73e5-494b-b99f-9d67a9d0420a" returned: 0 in 0.440s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a272dc-61fa-47ea-aa65-5644a6040b2b]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-quobyte-15152235-73e5-494b-b99f-9d67a9d0420a" released by "delete_volume" :: held 0.979s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Created reservations ['97a9ada4-7a84-4de1-903e-7f44a8c083d6', 'a20d865d-008f-4991-a10e-eec7033a33ca', '043d1ed2-c09b-4b90-8e8d-46d15357db9d', 'f2902471-1f74-4fc0-8b97-81ef9661e67f'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:55 devstack sudo[91140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 Apr 10 12:22:55 devstack sudo[91140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:55 devstack sudo[91142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:55 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:55 devstack sudo[91140]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3" returned: 0 in 0.508s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:55 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.435s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:55 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Deleted volume successfully. Apr 10 12:22:55 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3 Apr 10 12:22:55 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:55 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-fda77310-6e64-43f6-99c9-a524842e1748 tempest-SnapshotDependencyTests-1144936018 None] Lock "cinder-15152235-73e5-494b-b99f-9d67a9d0420a-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:56 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-589faec8-dbdc-4d13-93c1-774ecf1f50e3" returned: 0 in 0.460s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-quobyte-589faec8-dbdc-4d13-93c1-774ecf1f50e3" released by "delete_volume" :: held 1.001s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Created reservations ['ee372102-ba91-4af2-8692-3ffe98a9035b', '89995120-afc8-44db-a122-08be60429a56', 'eb37554e-4539-4bb3-8dfc-74f11453c6e1', '14d525df-6abd-4331-8e0a-ebfbd166b1ae'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:56 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:56 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:56 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.430s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:56 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Deleted volume successfully. Apr 10 12:22:56 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-0b95f456-8792-4200-804b-ee11c1f20f19 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-589faec8-dbdc-4d13-93c1-774ecf1f50e3-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "cinder-e95b5e13-d277-4fa1-a171-f3d87c101511-delete_volume" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-e95b5e13-d277-4fa1-a171-f3d87c101511-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "cinder-quobyte-e95b5e13-d277-4fa1-a171-f3d87c101511" by "delete_volume" {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 10 12:22:57 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-quobyte-e95b5e13-d277-4fa1-a171-f3d87c101511" acquired by "delete_volume" :: waited 0.010s {{(pid=82546) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 10 12:22:57 devstack cinder-volume[82546]: DEBUG oslo.privsep.daemon [-] privsep: reply[fedf329d-04fb-4c77-8594-d2921b23bf71]: (4, 'qcow2') {{(pid=83475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 10 12:22:57 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:57 devstack sudo[91155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 Apr 10 12:22:57 devstack sudo[91155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:58 devstack sudo[91155]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511" returned: 0 in 0.498s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:58 devstack sudo[91161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511 Apr 10 12:22:58 devstack sudo[91161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:58 devstack sudo[91161]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39/volume-e95b5e13-d277-4fa1-a171-f3d87c101511" returned: 0 in 0.465s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-quobyte-e95b5e13-d277-4fa1-a171-f3d87c101511" released by "delete_volume" :: held 0.990s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG cinder.quota [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Created reservations ['c301aae7-c319-4327-b54f-5b1a233025d5', '28e20adf-cf21-47ec-928b-09b7df6cc500', '622e576b-5623-4f2e-a9b9-45dfb06b6af6', 'd7a49665-65a1-4785-b5c7-e4d402975c15'] {{(pid=82546) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196': None} {{(pid=82546) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG cinder.volume.drivers.quobyte [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-910a19e4-2298-4bd9-ba83-c96ddb78b196'] {{(pid=82546) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.lockutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82546) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 10 12:22:58 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 10 12:22:58 devstack sudo[91164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39 Apr 10 12:22:58 devstack sudo[91164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 10 12:22:59 devstack sudo[91164]: pam_unix(sudo:session): session closed for user root Apr 10 12:22:59 devstack cinder-volume[82546]: DEBUG oslo_concurrency.processutils [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5ec31c6be26559f1648be2cf50d8df39" returned: 0 in 0.491s {{(pid=82546) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 10 12:22:59 devstack cinder-volume[82546]: DEBUG cinder.manager [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Notifying Schedulers of capabilities ... {{(pid=82546) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 10 12:22:59 devstack cinder-volume[82546]: INFO cinder.volume.manager [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Deleted volume successfully. Apr 10 12:22:59 devstack cinder-volume[82546]: DEBUG cinder.coordination [None req-95bfe2ae-5112-4668-b54f-54c75869c315 tempest-CinderUnicodeTest-1946710190 None] Lock "cinder-e95b5e13-d277-4fa1-a171-f3d87c101511-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=82546) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 10 12:23:08 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:SELECT=17,cinder:UPDATE=32,cinder:INSERT=5,cinder:DELETE=1 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 10 12:23:09 devstack cinder-volume[82546]: DEBUG dbcounter [-] [82546] Writing DB stats cinder:DELETE=3,cinder:SELECT=21,cinder:INSERT=11,cinder:UPDATE=26 {{(pid=82546) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}